2026-02-18T03:18:35.580 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T03:18:35.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T03:18:35.680 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515 branch: 20.2.1_2.17.26-baseline_2 description: nvmeof/thrash/{base/install centos_latest clusters/4-gateways-1-initiator conf/{disable-pool-app} gateway-initiator-setup/16-subsys-4-namespace thrashers/nvmeof_mon_thrash workloads/fio} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '54515' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: 20.2.1_2.17.26-baseline_2 ceph: conf: global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - OSD_DOWN - OSD_HOST_DOWN - OSD_ROOT_DOWN - osds down - PG_DEGRADED - MON_DOWN - mons down - mon down - out of quorum - CEPHADM_FAILED_DAEMON - NVMEOF_SINGLE_GATEWAY - NVMEOF_GATEWAY_DOWN - are in unavailable state - is unavailable - is in error state - failed cephadm daemon - CEPHADM_STRAY_DAEMON - CEPHADM_DAEMON_PLACE_FAIL sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed workunit: branch: 20.2.1_2.17.26-baseline_2 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - client.0 - - host.a - mon.a - mgr.x - osd.0 - osd.1 - client.1 - ceph.nvmeof.nvmeof.a - - host.b - mon.b - osd.2 - osd.3 - osd.4 - client.2 - ceph.nvmeof.nvmeof.b - - host.c - mon.c - osd.5 - osd.6 - osd.7 - client.3 - ceph.nvmeof.nvmeof.c - - host.d - client.4 - ceph.nvmeof.nvmeof.d seed: 7043 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed sleep_before_teardown: 0 subset: 111/120000 suite: nvmeof suite_branch: 20.2.1_2.17.26-baseline_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed targets: trial014.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3NF4Ap52LVWuLLTGMuKkmG7YIA1XGwJgUgWIWd96/e7a/rxGbwQMz5BxEssziiyexgKACfuynxaicyhxucpKg= trial034.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2hlmMnl6FZnmeGZVwFVXJ2AW61BTLojpQphwhlHDaoenGiHP6RCbjKS/FFebAdTGMSJlKw5jhz2ujx/oKmrvc= trial086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYSNo0tZeMEWQsd2s+fXfvHxZFSzW7wcnlUojihvJMmWbDfa3ecwrSOddIer5SUQrCQ/XOmusYl3PXdsnx1UQw= trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGJPVzJHMIDcgwuJb/z6pAnlc6/nBkJ+d3nTClLKdKntfCer1XclS+PHDdv91w5OMxOoq9ZCMZM2FuxRrAhBBw= trial177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJxuhCoHdaqNNAxAb0nLxEtgpJ8huaIavFvpMwAYNYTUNJd5K8vxiL8OGB5w3dBvyBKs/iMqTvlaa0mDKu/0hE= tasks: - install: extra_packages: - nvme-cli - cephadm: null - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch host ls - ceph orch device ls - ceph osd lspools - nvmeof: gateway_config: cli_image: quay.io/ceph/nvmeof-cli:devel namespaces_count: 4 subsystems_count: 16 gw_image: quay.io/ceph/nvmeof:devel installer: host.a rbd: image_name_prefix: myimage pool_name: mypool - cephadm.wait_for_service: service: nvmeof.mypool.mygroup0 - workunit: clients: client.0: - nvmeof/setup_subsystem.sh - nvmeof/basic_tests.sh env: RBD_IMAGE_PREFIX: myimage RBD_POOL: mypool no_coverage_and_limits: true - nvmeof.thrash: checker_host: client.0 switch_thrashers: true - mon_thrash: logger: '[nvmeof.thrasher.mon_thrasher]' revive_delay: 60 switch_thrashers: true thrash_delay: 60 thrash_many: true - workunit: clients: client.0: - nvmeof/fio_test.sh --random_devices 32 env: IOSTAT_INTERVAL: '10' NVMEOF_GROUP: mygroup0 RBD_POOL: mypool RUNTIME: '1200' no_coverage_and_limits: true timeout: 60m teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_21:21:52 tube: trial use_shaman: true user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T03:18:35.680 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa; will attempt to use it 2026-02-18T03:18:35.681 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks 2026-02-18T03:18:35.681 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T03:18:35.682 INFO:teuthology.task.internal:Checking packages... 2026-02-18T03:18:35.682 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'adc1923395f2bcd6ae89b5d331d278364d1848ed' 2026-02-18T03:18:35.682 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T03:18:35.682 INFO:teuthology.packaging:ref: None 2026-02-18T03:18:35.682 INFO:teuthology.packaging:tag: None 2026-02-18T03:18:35.682 INFO:teuthology.packaging:branch: 20.2.1_2.17.26-baseline_2 2026-02-18T03:18:35.682 INFO:teuthology.packaging:sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:18:35.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=20.2.1_2.17.26-baseline_2 2026-02-18T03:18:35.798 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-670.gadc19233 2026-02-18T03:18:35.799 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T03:18:35.810 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T03:18:35.810 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T03:18:35.823 INFO:teuthology.task.internal:Saving configuration 2026-02-18T03:18:35.835 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T03:18:35.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T03:18:35.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial014.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:15:03.816109', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3NF4Ap52LVWuLLTGMuKkmG7YIA1XGwJgUgWIWd96/e7a/rxGbwQMz5BxEssziiyexgKACfuynxaicyhxucpKg='} 2026-02-18T03:18:35.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial034.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:15:03.816579', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2hlmMnl6FZnmeGZVwFVXJ2AW61BTLojpQphwhlHDaoenGiHP6RCbjKS/FFebAdTGMSJlKw5jhz2ujx/oKmrvc='} 2026-02-18T03:18:36.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial086.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:15:03.815477', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYSNo0tZeMEWQsd2s+fXfvHxZFSzW7wcnlUojihvJMmWbDfa3ecwrSOddIer5SUQrCQ/XOmusYl3PXdsnx1UQw='} 2026-02-18T03:18:36.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:15:03.817352', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGJPVzJHMIDcgwuJb/z6pAnlc6/nBkJ+d3nTClLKdKntfCer1XclS+PHDdv91w5OMxOoq9ZCMZM2FuxRrAhBBw='} 2026-02-18T03:18:36.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial177.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 03:15:03.816980', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJxuhCoHdaqNNAxAb0nLxEtgpJ8huaIavFvpMwAYNYTUNJd5K8vxiL8OGB5w3dBvyBKs/iMqTvlaa0mDKu/0hE='} 2026-02-18T03:18:36.138 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T03:18:36.154 INFO:teuthology.task.internal:roles: ubuntu@trial014.front.sepia.ceph.com - ['client.0'] 2026-02-18T03:18:36.154 INFO:teuthology.task.internal:roles: ubuntu@trial034.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.1', 'ceph.nvmeof.nvmeof.a'] 2026-02-18T03:18:36.154 INFO:teuthology.task.internal:roles: ubuntu@trial086.front.sepia.ceph.com - ['host.b', 'mon.b', 'osd.2', 'osd.3', 'osd.4', 'client.2', 'ceph.nvmeof.nvmeof.b'] 2026-02-18T03:18:36.154 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.5', 'osd.6', 'osd.7', 'client.3', 'ceph.nvmeof.nvmeof.c'] 2026-02-18T03:18:36.154 INFO:teuthology.task.internal:roles: ubuntu@trial177.front.sepia.ceph.com - ['host.d', 'client.4', 'ceph.nvmeof.nvmeof.d'] 2026-02-18T03:18:36.154 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T03:18:36.522 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76f23d59c360>, signals=[15]) 2026-02-18T03:18:36.522 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T03:18:36.534 INFO:teuthology.task.internal:Opening connections... 2026-02-18T03:18:36.534 DEBUG:teuthology.task.internal:connecting to ubuntu@trial014.front.sepia.ceph.com 2026-02-18T03:18:36.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:18:36.598 DEBUG:teuthology.task.internal:connecting to ubuntu@trial034.front.sepia.ceph.com 2026-02-18T03:18:36.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:18:36.659 DEBUG:teuthology.task.internal:connecting to ubuntu@trial086.front.sepia.ceph.com 2026-02-18T03:18:36.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:18:36.721 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-18T03:18:36.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:18:36.782 DEBUG:teuthology.task.internal:connecting to ubuntu@trial177.front.sepia.ceph.com 2026-02-18T03:18:36.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:18:36.843 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T03:18:36.855 DEBUG:teuthology.orchestra.run.trial014:> uname -m 2026-02-18T03:18:36.870 INFO:teuthology.orchestra.run.trial014.stdout:x86_64 2026-02-18T03:18:36.870 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:18:36.925 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:18:36.926 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:18:36.926 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-18T03:18:37.005 DEBUG:teuthology.orchestra.run.trial034:> uname -m 2026-02-18T03:18:37.020 INFO:teuthology.orchestra.run.trial034.stdout:x86_64 2026-02-18T03:18:37.020 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:18:37.077 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:18:37.078 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:18:37.078 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:18:37.078 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:18:37.078 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server 2026-02-18T03:18:37.153 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-18T03:18:37.169 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-18T03:18:37.169 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-18T03:18:37.224 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-18T03:18:37.224 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-18T03:18:37.224 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-18T03:18:37.224 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:18:37.225 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:18:37.225 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-18T03:18:37.306 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-18T03:18:37.322 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-18T03:18:37.322 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:18:37.378 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:18:37.379 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:18:37.379 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:18:37.379 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:18:37.379 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-18T03:18:37.462 DEBUG:teuthology.orchestra.run.trial177:> uname -m 2026-02-18T03:18:37.477 INFO:teuthology.orchestra.run.trial177.stdout:x86_64 2026-02-18T03:18:37.477 DEBUG:teuthology.orchestra.run.trial177:> cat /etc/os-release 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:NAME="CentOS Stream" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:VERSION="9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:ID="centos" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:ID_LIKE="rhel fedora" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:VERSION_ID="9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:PLATFORM_ID="platform:el9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:ANSI_COLOR="0;31" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:LOGO="fedora-logo-icon" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:HOME_URL="https://centos.org/" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T03:18:37.533 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T03:18:37.534 INFO:teuthology.lock.ops:Updating trial177.front.sepia.ceph.com on lock server 2026-02-18T03:18:37.612 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T03:18:37.626 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T03:18:37.637 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T03:18:37.637 DEBUG:teuthology.orchestra.run.trial014:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:18:37.639 DEBUG:teuthology.orchestra.run.trial034:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:18:37.640 DEBUG:teuthology.orchestra.run.trial086:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:18:37.642 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:18:37.643 DEBUG:teuthology.orchestra.run.trial177:> test '!' -e /home/ubuntu/cephtest 2026-02-18T03:18:37.660 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T03:18:37.671 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T03:18:37.671 DEBUG:teuthology.orchestra.run.trial014:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:18:37.695 DEBUG:teuthology.orchestra.run.trial034:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:18:37.697 DEBUG:teuthology.orchestra.run.trial086:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:18:37.699 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:18:37.701 DEBUG:teuthology.orchestra.run.trial177:> test -z $(ls -A /var/lib/ceph) 2026-02-18T03:18:37.718 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T03:18:38.051 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T03:18:38.070 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-18T03:18:38.071 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.d': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-18T03:18:38.071 DEBUG:teuthology.orchestra.run.trial014:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:18:38.071 DEBUG:teuthology.orchestra.run.trial034:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:18:38.071 DEBUG:teuthology.orchestra.run.trial086:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:18:38.073 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:18:38.073 DEBUG:teuthology.orchestra.run.trial177:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T03:18:38.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:38.088 DEBUG:teuthology.orchestra.run.trial034:> uname -r 2026-02-18T03:18:38.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:38.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:38.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:38.088 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-18T03:18:38.089 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-18T03:18:38.089 DEBUG:teuthology.orchestra.run.trial177:> uname -r 2026-02-18T03:18:38.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:18:38.089 DEBUG:teuthology.orchestra.run.trial014:> uname -r 2026-02-18T03:18:38.143 INFO:teuthology.orchestra.run.trial034.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:18:38.143 INFO:teuthology.task.kernel:Running kernel on trial034: 5.14.0-645.el9.x86_64 2026-02-18T03:18:38.143 DEBUG:teuthology.orchestra.run.trial034:> sudo yum install -y kernel 2026-02-18T03:18:38.144 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:18:38.144 INFO:teuthology.orchestra.run.trial177.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:18:38.144 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-645.el9.x86_64 2026-02-18T03:18:38.144 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-18T03:18:38.144 INFO:teuthology.task.kernel:Running kernel on trial177: 5.14.0-645.el9.x86_64 2026-02-18T03:18:38.144 DEBUG:teuthology.orchestra.run.trial177:> sudo yum install -y kernel 2026-02-18T03:18:38.145 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:18:38.145 INFO:teuthology.orchestra.run.trial014.stdout:5.14.0-645.el9.x86_64 2026-02-18T03:18:38.145 INFO:teuthology.task.kernel:Running kernel on trial086: 5.14.0-645.el9.x86_64 2026-02-18T03:18:38.145 DEBUG:teuthology.orchestra.run.trial086:> sudo yum install -y kernel 2026-02-18T03:18:38.145 INFO:teuthology.task.kernel:Running kernel on trial014: 5.14.0-645.el9.x86_64 2026-02-18T03:18:38.146 DEBUG:teuthology.orchestra.run.trial014:> sudo yum install -y kernel 2026-02-18T03:18:39.220 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-18T03:18:39.228 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-18T03:18:39.228 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-18T03:18:39.323 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-18T03:18:39.941 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.9 MB 00:01 2026-02-18T03:18:41.734 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 14 MB/s | 27 MB 00:01 2026-02-18T03:18:42.673 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 27 MB 00:02 2026-02-18T03:18:42.968 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-18T03:18:43.140 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-18T03:18:44.455 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 27 MB 00:04 2026-02-18T03:18:45.120 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-18T03:18:45.940 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-18T03:18:46.086 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 20 kB 00:00 2026-02-18T03:18:46.363 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-18T03:18:47.209 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 7.8 MB 00:01 2026-02-18T03:18:47.211 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 161 kB/s | 20 kB 00:00 2026-02-18T03:18:47.441 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-18T03:18:47.545 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-18T03:18:47.707 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 47 MB/s | 20 MB 00:00 2026-02-18T03:18:47.815 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 7.8 MB 00:00 2026-02-18T03:18:48.693 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-18T03:18:49.227 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-18T03:18:49.566 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-18T03:18:49.883 INFO:teuthology.orchestra.run.trial014.stdout:Extra Packages for Enterprise Linux 79 MB/s | 20 MB 00:00 2026-02-18T03:18:50.274 INFO:teuthology.orchestra.run.trial177.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-18T03:18:50.640 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:18:50.868 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-18T03:18:51.651 INFO:teuthology.orchestra.run.trial034.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:18:51.673 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:18:51.674 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:18:51.674 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:18:51.675 INFO:teuthology.orchestra.run.trial034.stdout:Install 4 Packages 2026-02-18T03:18:51.676 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:18:51.676 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 88 M 2026-02-18T03:18:51.676 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 135 M 2026-02-18T03:18:51.676 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:18:51.815 INFO:teuthology.orchestra.run.trial034.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2026-02-18T03:18:51.887 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:18:51.905 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-18T03:18:51.909 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:18:51.910 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:Install 4 Packages 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 88 M 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 135 M 2026-02-18T03:18:51.911 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:18:51.973 INFO:teuthology.orchestra.run.trial034.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 79 MB/s | 17 MB 00:00 2026-02-18T03:18:52.306 INFO:teuthology.orchestra.run.trial034.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 72 MB/s | 40 MB 00:00 2026-02-18T03:18:52.347 INFO:teuthology.orchestra.run.trial034.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 58 MB/s | 31 MB 00:00 2026-02-18T03:18:52.347 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:52.347 INFO:teuthology.orchestra.run.trial034.stdout:Total 131 MB/s | 88 MB 00:00 2026-02-18T03:18:52.536 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:18:52.740 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:18:52.740 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:18:52.918 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:18:52.940 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:18:52.942 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:Install 4 Packages 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 88 M 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 135 M 2026-02-18T03:18:52.943 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:18:53.087 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:18:53.087 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:18:53.096 INFO:teuthology.orchestra.run.trial014.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:18:53.226 INFO:teuthology.orchestra.run.trial086.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 638 kB/s | 803 kB 00:01 2026-02-18T03:18:53.465 INFO:teuthology.orchestra.run.trial177.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:18:54.106 INFO:teuthology.orchestra.run.trial014.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:18:54.129 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:18:54.130 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:18:54.130 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:54.130 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:18:54.130 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout:Install 4 Packages 2026-02-18T03:18:54.131 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:18:54.132 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 88 M 2026-02-18T03:18:54.132 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 135 M 2026-02-18T03:18:54.132 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:18:54.170 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:18:54.451 INFO:teuthology.orchestra.run.trial034.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:18:54.470 INFO:teuthology.orchestra.run.trial034.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:54.472 INFO:teuthology.orchestra.run.trial177.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T03:18:54.494 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-18T03:18:54.496 INFO:teuthology.orchestra.run.trial177.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:Install 4 Packages 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 88 M 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 135 M 2026-02-18T03:18:54.497 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:18:54.518 INFO:teuthology.orchestra.run.trial014.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 6.1 MB/s | 803 kB 00:00 2026-02-18T03:18:54.534 INFO:teuthology.orchestra.run.trial086.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 6.7 MB/s | 17 MB 00:02 2026-02-18T03:18:54.668 INFO:teuthology.orchestra.run.trial086.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 15 MB/s | 40 MB 00:02 2026-02-18T03:18:54.800 INFO:teuthology.orchestra.run.trial014.stdout:(2/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 96 MB/s | 40 MB 00:00 2026-02-18T03:18:55.077 INFO:teuthology.orchestra.run.trial155.stdout:(1/4): kernel-core-5.14.0-681.el9.x86_64.rpm 9.3 MB/s | 17 MB 00:01 2026-02-18T03:18:55.147 INFO:teuthology.orchestra.run.trial014.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 49 MB/s | 31 MB 00:00 2026-02-18T03:18:55.489 INFO:teuthology.orchestra.run.trial086.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 14 MB/s | 31 MB 00:02 2026-02-18T03:18:55.491 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:55.491 INFO:teuthology.orchestra.run.trial086.stdout:Total 25 MB/s | 88 MB 00:03 2026-02-18T03:18:55.605 INFO:teuthology.orchestra.run.trial155.stdout:(2/4): kernel-5.14.0-681.el9.x86_64.rpm 340 kB/s | 803 kB 00:02 2026-02-18T03:18:55.683 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:18:55.845 INFO:teuthology.orchestra.run.trial014.stdout:(4/4): kernel-core-5.14.0-681.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-18T03:18:55.845 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:55.845 INFO:teuthology.orchestra.run.trial014.stdout:Total 52 MB/s | 88 MB 00:01 2026-02-18T03:18:55.887 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:18:55.888 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:18:56.037 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:18:56.049 INFO:teuthology.orchestra.run.trial177.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 539 kB/s | 803 kB 00:01 2026-02-18T03:18:56.232 INFO:teuthology.orchestra.run.trial177.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 10 MB/s | 17 MB 00:01 2026-02-18T03:18:56.234 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:18:56.235 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:18:56.246 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:56.247 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:18:56.247 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:18:56.274 INFO:teuthology.orchestra.run.trial034.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:18:56.365 INFO:teuthology.orchestra.run.trial155.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 24 MB/s | 31 MB 00:01 2026-02-18T03:18:56.594 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:18:56.594 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:18:57.324 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:18:57.512 INFO:teuthology.orchestra.run.trial177.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 13 MB/s | 40 MB 00:02 2026-02-18T03:18:57.607 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:18:57.626 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:57.676 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:18:57.799 INFO:teuthology.orchestra.run.trial177.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-18T03:18:57.801 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:57.802 INFO:teuthology.orchestra.run.trial177.stdout:Total 27 MB/s | 88 MB 00:03 2026-02-18T03:18:57.960 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:18:57.979 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:57.990 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:18:58.057 INFO:teuthology.orchestra.run.trial155.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 8.2 MB/s | 40 MB 00:04 2026-02-18T03:18:58.059 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:18:58.060 INFO:teuthology.orchestra.run.trial155.stdout:Total 17 MB/s | 88 MB 00:05 2026-02-18T03:18:58.197 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:18:58.197 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:18:58.252 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:18:58.457 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:18:58.457 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:18:58.545 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:18:58.545 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:18:58.805 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:18:58.805 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:18:59.301 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:18:59.307 INFO:teuthology.orchestra.run.trial034.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:18:59.409 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:59.438 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:18:59.632 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:18:59.768 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:18:59.797 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:18:59.888 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:18:59.912 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:18:59.931 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:00.170 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:00.189 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:01.705 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:01.733 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:01.968 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:01.997 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:02.341 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:02.674 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:02.681 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:02.820 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:02.826 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:04.823 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:04.830 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:05.080 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:05.087 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:05.723 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:06.087 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:07.929 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:08.121 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:32.587 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:32.608 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:32.672 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:32.672 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:32.672 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:32.672 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:32.723 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:32.723 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:19:32.724 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:19:32.782 DEBUG:teuthology.orchestra.run.trial034:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:32.808 INFO:teuthology.orchestra.run.trial034.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.809 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:32.809 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:19:32.809 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:19:32.810 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:19:32.810 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-18T03:19:32.810 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial034.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:19:32.810 DEBUG:teuthology.orchestra.run.trial034:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:32.874 INFO:teuthology.orchestra.run.trial034.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:32.875 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:32.876 DEBUG:teuthology.orchestra.run.trial034:> sudo rpm -qi grub2-tools 2026-02-18T03:19:32.943 INFO:teuthology.orchestra.run.trial034.stdout:Name : grub2-tools 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Epoch : 1 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Version : 2.06 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Release : 118.el9 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Architecture: x86_64 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Group : Unspecified 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Size : 8393909 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:License : GPLv3+ 2026-02-18T03:19:32.944 INFO:teuthology.orchestra.run.trial034.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Packager : builder@centos.org 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Vendor : CentOS 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Summary : Support tools for GRUB. 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:Description : 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:19:32.945 INFO:teuthology.orchestra.run.trial034.stdout:hardware devices. 2026-02-18T03:19:32.946 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:19:32.946 INFO:teuthology.orchestra.run.trial034.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:19:32.947 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:19:32.947 INFO:teuthology.task.kernel:Updating grub on trial034 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:19:32.947 DEBUG:teuthology.orchestra.run.trial034:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:19:33.011 INFO:teuthology.orchestra.run.trial034.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:33.012 DEBUG:teuthology.orchestra.run.trial034:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:19:33.076 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/grubby 2026-02-18T03:19:33.077 INFO:teuthology.orchestra.run.trial034.stdout:yes 2026-02-18T03:19:33.078 DEBUG:teuthology.orchestra.run.trial034:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:19:33.141 INFO:teuthology.orchestra.run.trial034.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:33.142 DEBUG:teuthology.orchestra.run.trial034:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:19:33.215 DEBUG:teuthology.orchestra.run.trial034:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:19:33.421 INFO:teuthology.orchestra.run.trial034.stderr:Generating grub configuration file ... 2026-02-18T03:19:33.484 INFO:teuthology.orchestra.run.trial034.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:19:33.490 INFO:teuthology.orchestra.run.trial034.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:19:33.733 INFO:teuthology.orchestra.run.trial034.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:19:33.739 INFO:teuthology.orchestra.run.trial034.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:19:33.770 INFO:teuthology.orchestra.run.trial034.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:19:33.777 INFO:teuthology.orchestra.run.trial034.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:19:33.800 INFO:teuthology.orchestra.run.trial034.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:19:33.807 INFO:teuthology.orchestra.run.trial034.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:19:33.889 INFO:teuthology.orchestra.run.trial034.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:19:33.896 INFO:teuthology.orchestra.run.trial034.stderr:done 2026-02-18T03:19:33.898 DEBUG:teuthology.orchestra.run.trial034:> test -d /sys/firmware/efi 2026-02-18T03:19:33.914 DEBUG:teuthology.orchestra.run.trial034:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:19:33.979 INFO:teuthology.orchestra.run.trial034.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:19:33.979 INFO:teuthology.orchestra.run.trial034.stdout:/boot/efi/EFI/centos 2026-02-18T03:19:33.981 DEBUG:teuthology.orchestra.run.trial034:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:19:34.048 INFO:teuthology.orchestra.run.trial034.stdout:no 2026-02-18T03:19:34.048 DEBUG:teuthology.orchestra.run.trial034:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:19:34.113 INFO:teuthology.orchestra.run.trial034.stdout:yes 2026-02-18T03:19:34.113 DEBUG:teuthology.orchestra.run.trial034:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:19:34.176 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial034 2026-02-18T03:19:34.177 DEBUG:teuthology.orchestra.run.trial034:> sudo bash -c ' 2026-02-18T03:19:34.177 DEBUG:teuthology.orchestra.run.trial034:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:19:34.177 DEBUG:teuthology.orchestra.run.trial034:> ' 2026-02-18T03:19:36.018 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.040 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.211 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.211 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:36.211 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:36.211 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.263 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.264 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:19:36.264 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:19:36.321 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:36.346 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.348 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.348 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.348 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:19:36.348 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:19:36.348 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-18T03:19:36.348 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial086.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:19:36.348 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:36.413 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.414 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.414 DEBUG:teuthology.orchestra.run.trial086:> sudo rpm -qi grub2-tools 2026-02-18T03:19:36.482 INFO:teuthology.orchestra.run.trial086.stdout:Name : grub2-tools 2026-02-18T03:19:36.482 INFO:teuthology.orchestra.run.trial086.stdout:Epoch : 1 2026-02-18T03:19:36.482 INFO:teuthology.orchestra.run.trial086.stdout:Version : 2.06 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Release : 118.el9 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Architecture: x86_64 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Group : Unspecified 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Size : 8393909 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:License : GPLv3+ 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Packager : builder@centos.org 2026-02-18T03:19:36.483 INFO:teuthology.orchestra.run.trial086.stdout:Vendor : CentOS 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:Summary : Support tools for GRUB. 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:Description : 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:19:36.484 INFO:teuthology.orchestra.run.trial086.stdout:hardware devices. 2026-02-18T03:19:36.485 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:19:36.485 INFO:teuthology.orchestra.run.trial086.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:19:36.485 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.486 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:19:36.486 INFO:teuthology.task.kernel:Updating grub on trial086 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.487 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:19:36.505 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.551 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:36.553 DEBUG:teuthology.orchestra.run.trial086:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:19:36.568 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.569 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:36.569 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:36.569 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:36.616 INFO:teuthology.orchestra.run.trial086.stdout:/sbin/grubby 2026-02-18T03:19:36.618 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-18T03:19:36.618 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:19:36.621 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:36.621 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:19:36.621 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:19:36.621 INFO:teuthology.orchestra.run.trial014.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.622 INFO:teuthology.orchestra.run.trial014.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.622 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.622 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.622 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:19:36.622 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:19:36.681 DEBUG:teuthology.orchestra.run.trial014:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:36.682 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:36.684 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.706 INFO:teuthology.orchestra.run.trial014.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.707 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.707 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.707 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:19:36.707 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:19:36.708 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-18T03:19:36.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial014.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:19:36.708 DEBUG:teuthology.orchestra.run.trial014:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:36.756 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:19:36.770 INFO:teuthology.orchestra.run.trial014.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:36.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.772 DEBUG:teuthology.orchestra.run.trial014:> sudo rpm -qi grub2-tools 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Name : grub2-tools 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Epoch : 1 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Version : 2.06 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Release : 118.el9 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Architecture: x86_64 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Group : Unspecified 2026-02-18T03:19:36.840 INFO:teuthology.orchestra.run.trial014.stdout:Size : 8393909 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:License : GPLv3+ 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Packager : builder@centos.org 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Vendor : CentOS 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Summary : Support tools for GRUB. 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout:Description : 2026-02-18T03:19:36.841 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout:hardware devices. 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:19:36.842 INFO:teuthology.orchestra.run.trial014.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:19:36.843 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:19:36.843 INFO:teuthology.task.kernel:Updating grub on trial014 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:19:36.843 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:19:36.907 INFO:teuthology.orchestra.run.trial014.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:36.909 DEBUG:teuthology.orchestra.run.trial014:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:19:36.962 INFO:teuthology.orchestra.run.trial086.stderr:Generating grub configuration file ... 2026-02-18T03:19:36.971 INFO:teuthology.orchestra.run.trial014.stdout:/sbin/grubby 2026-02-18T03:19:36.972 INFO:teuthology.orchestra.run.trial014.stdout:yes 2026-02-18T03:19:36.973 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:19:37.026 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:19:37.032 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:19:37.036 INFO:teuthology.orchestra.run.trial014.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:37.038 DEBUG:teuthology.orchestra.run.trial014:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:19:37.110 DEBUG:teuthology.orchestra.run.trial014:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:19:37.283 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:19:37.289 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:19:37.320 INFO:teuthology.orchestra.run.trial014.stderr:Generating grub configuration file ... 2026-02-18T03:19:37.321 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:19:37.328 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:19:37.351 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:19:37.358 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:19:37.382 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:19:37.389 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:19:37.439 INFO:teuthology.orchestra.run.trial086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:19:37.447 INFO:teuthology.orchestra.run.trial086.stderr:done 2026-02-18T03:19:37.448 DEBUG:teuthology.orchestra.run.trial086:> test -d /sys/firmware/efi 2026-02-18T03:19:37.463 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:19:37.528 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:19:37.528 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/centos 2026-02-18T03:19:37.530 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:19:37.596 INFO:teuthology.orchestra.run.trial086.stdout:no 2026-02-18T03:19:37.596 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:19:37.643 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:19:37.650 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:19:37.662 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-18T03:19:37.663 DEBUG:teuthology.orchestra.run.trial086:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:19:37.681 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:19:37.687 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:19:37.711 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:19:37.717 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:19:37.726 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial086 2026-02-18T03:19:37.726 DEBUG:teuthology.orchestra.run.trial086:> sudo bash -c ' 2026-02-18T03:19:37.726 DEBUG:teuthology.orchestra.run.trial086:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:19:37.726 DEBUG:teuthology.orchestra.run.trial086:> ' 2026-02-18T03:19:37.799 INFO:teuthology.orchestra.run.trial014.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:19:37.807 INFO:teuthology.orchestra.run.trial014.stderr:done 2026-02-18T03:19:37.809 DEBUG:teuthology.orchestra.run.trial014:> test -d /sys/firmware/efi 2026-02-18T03:19:37.825 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:19:37.889 INFO:teuthology.orchestra.run.trial014.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:19:37.889 INFO:teuthology.orchestra.run.trial014.stdout:/boot/efi/EFI/centos 2026-02-18T03:19:37.891 DEBUG:teuthology.orchestra.run.trial014:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:19:37.955 INFO:teuthology.orchestra.run.trial014.stdout:no 2026-02-18T03:19:37.956 DEBUG:teuthology.orchestra.run.trial014:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:19:38.020 INFO:teuthology.orchestra.run.trial014.stdout:yes 2026-02-18T03:19:38.020 DEBUG:teuthology.orchestra.run.trial014:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:19:38.084 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial014 2026-02-18T03:19:38.084 DEBUG:teuthology.orchestra.run.trial014:> sudo bash -c ' 2026-02-18T03:19:38.084 DEBUG:teuthology.orchestra.run.trial014:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:19:38.084 DEBUG:teuthology.orchestra.run.trial014:> ' 2026-02-18T03:19:38.447 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.467 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.524 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.530 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.531 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:38.531 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:38.531 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:38.546 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:19:38.582 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:19:38.611 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.611 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T03:19:38.611 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T03:19:38.611 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T03:19:38.640 DEBUG:teuthology.orchestra.run.trial177:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:38.663 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:19:38.664 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:19:38.666 INFO:teuthology.orchestra.run.trial177.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.667 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.667 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:19:38.667 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:19:38.668 INFO:teuthology.task.kernel:Installing distro kernel on host.d... 2026-02-18T03:19:38.668 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial177.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:19:38.668 DEBUG:teuthology.orchestra.run.trial177:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:38.722 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:38.729 INFO:teuthology.orchestra.run.trial177.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.730 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.731 DEBUG:teuthology.orchestra.run.trial177:> sudo rpm -qi grub2-tools 2026-02-18T03:19:38.747 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.748 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.748 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.748 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T03:19:38.749 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T03:19:38.749 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2026-02-18T03:19:38.749 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial155.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T03:19:38.749 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T03:19:38.799 INFO:teuthology.orchestra.run.trial177.stdout:Name : grub2-tools 2026-02-18T03:19:38.799 INFO:teuthology.orchestra.run.trial177.stdout:Epoch : 1 2026-02-18T03:19:38.799 INFO:teuthology.orchestra.run.trial177.stdout:Version : 2.06 2026-02-18T03:19:38.799 INFO:teuthology.orchestra.run.trial177.stdout:Release : 118.el9 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Architecture: x86_64 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Group : Unspecified 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Size : 8393909 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:License : GPLv3+ 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Packager : builder@centos.org 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:Vendor : CentOS 2026-02-18T03:19:38.800 INFO:teuthology.orchestra.run.trial177.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:Summary : Support tools for GRUB. 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:Description : 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:hardware devices. 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:19:38.801 INFO:teuthology.orchestra.run.trial177.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:19:38.802 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:19:38.803 INFO:teuthology.task.kernel:Updating grub on trial177 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.803 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:19:38.811 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T03:19:38.812 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.812 DEBUG:teuthology.orchestra.run.trial155:> sudo rpm -qi grub2-tools 2026-02-18T03:19:38.866 INFO:teuthology.orchestra.run.trial177.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:38.867 DEBUG:teuthology.orchestra.run.trial177:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:19:38.882 INFO:teuthology.orchestra.run.trial155.stdout:Name : grub2-tools 2026-02-18T03:19:38.882 INFO:teuthology.orchestra.run.trial155.stdout:Epoch : 1 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Version : 2.06 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Release : 118.el9 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Architecture: x86_64 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Group : Unspecified 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Size : 8393909 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:License : GPLv3+ 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T03:19:38.883 INFO:teuthology.orchestra.run.trial155.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:Packager : builder@centos.org 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:Vendor : CentOS 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:Summary : Support tools for GRUB. 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:Description : 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout:hardware devices. 2026-02-18T03:19:38.884 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:19:38.885 INFO:teuthology.orchestra.run.trial155.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T03:19:38.886 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T03:19:38.886 INFO:teuthology.task.kernel:Updating grub on trial155 to boot 5.14.0-681.el9.x86_64 2026-02-18T03:19:38.886 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T03:19:38.933 INFO:teuthology.orchestra.run.trial177.stdout:/sbin/grubby 2026-02-18T03:19:38.935 INFO:teuthology.orchestra.run.trial177.stdout:yes 2026-02-18T03:19:38.936 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:19:38.949 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:38.950 DEBUG:teuthology.orchestra.run.trial155:> sudo command -v grubby && echo yes || echo no 2026-02-18T03:19:39.000 INFO:teuthology.orchestra.run.trial177.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:39.001 DEBUG:teuthology.orchestra.run.trial177:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:19:39.013 INFO:teuthology.orchestra.run.trial155.stdout:/sbin/grubby 2026-02-18T03:19:39.014 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-18T03:19:39.015 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T03:19:39.076 DEBUG:teuthology.orchestra.run.trial177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:19:39.079 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T03:19:39.080 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T03:19:39.154 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T03:19:39.287 INFO:teuthology.orchestra.run.trial177.stderr:Generating grub configuration file ... 2026-02-18T03:19:39.351 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:19:39.358 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:19:39.365 INFO:teuthology.orchestra.run.trial155.stderr:Generating grub configuration file ... 2026-02-18T03:19:39.428 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T03:19:39.435 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T03:19:39.613 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:19:39.620 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:19:39.652 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:19:39.659 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:19:39.682 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:19:39.687 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T03:19:39.689 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:19:39.694 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T03:19:39.726 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T03:19:39.732 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T03:19:39.755 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T03:19:39.762 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T03:19:39.772 INFO:teuthology.orchestra.run.trial177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:19:39.781 INFO:teuthology.orchestra.run.trial177.stderr:done 2026-02-18T03:19:39.783 DEBUG:teuthology.orchestra.run.trial177:> test -d /sys/firmware/efi 2026-02-18T03:19:39.798 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:19:39.842 INFO:teuthology.orchestra.run.trial155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T03:19:39.850 INFO:teuthology.orchestra.run.trial155.stderr:done 2026-02-18T03:19:39.853 DEBUG:teuthology.orchestra.run.trial155:> test -d /sys/firmware/efi 2026-02-18T03:19:39.863 INFO:teuthology.orchestra.run.trial177.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:19:39.864 INFO:teuthology.orchestra.run.trial177.stdout:/boot/efi/EFI/centos 2026-02-18T03:19:39.865 DEBUG:teuthology.orchestra.run.trial177:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:19:39.868 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T03:19:39.933 INFO:teuthology.orchestra.run.trial177.stdout:no 2026-02-18T03:19:39.933 DEBUG:teuthology.orchestra.run.trial177:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:19:39.934 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/BOOT 2026-02-18T03:19:39.934 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/centos 2026-02-18T03:19:39.935 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T03:19:39.999 INFO:teuthology.orchestra.run.trial177.stdout:yes 2026-02-18T03:19:40.000 DEBUG:teuthology.orchestra.run.trial177:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:19:40.001 INFO:teuthology.orchestra.run.trial155.stdout:no 2026-02-18T03:19:40.001 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T03:19:40.065 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial177 2026-02-18T03:19:40.066 DEBUG:teuthology.orchestra.run.trial177:> sudo bash -c ' 2026-02-18T03:19:40.066 DEBUG:teuthology.orchestra.run.trial177:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:19:40.066 DEBUG:teuthology.orchestra.run.trial177:> ' 2026-02-18T03:19:40.067 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-18T03:19:40.068 DEBUG:teuthology.orchestra.run.trial155:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T03:19:40.132 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial155 2026-02-18T03:19:40.132 DEBUG:teuthology.orchestra.run.trial155:> sudo bash -c ' 2026-02-18T03:19:40.132 DEBUG:teuthology.orchestra.run.trial155:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T03:19:40.132 DEBUG:teuthology.orchestra.run.trial155:> ' 2026-02-18T03:20:04.220 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-18T03:20:04.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-18T03:20:04.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:20:07.769 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-18T03:20:07.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-18T03:20:07.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:20:08.127 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-18T03:20:08.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-18T03:20:08.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:20:10.109 INFO:teuthology.task.kernel:Checking client host.d for new kernel version... 2026-02-18T03:20:10.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-18T03:20:10.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:20:10.175 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2026-02-18T03:20:10.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-18T03:20:10.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:04.277 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:21:07.776 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:21:08.131 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:21:10.115 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:21:10.179 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T03:21:13.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-18T03:21:13.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:13.414 DEBUG:teuthology.orchestra.run.trial034:> true 2026-02-18T03:21:13.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-18T03:21:13.569 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:21:13.569 DEBUG:teuthology.orchestra.run.trial034:> uname -r 2026-02-18T03:21:13.626 INFO:teuthology.orchestra.run.trial034.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:21:13.627 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:21:13.627 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:21:13.627 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:21:14.628 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-18T03:21:14.628 DEBUG:teuthology.orchestra.run.trial034:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:21:14.658 INFO:teuthology.orchestra.run.trial034.stdout:ttyS1 2026-02-18T03:21:14.682 DEBUG:teuthology.parallel:result is None 2026-02-18T03:21:16.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-18T03:21:16.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:16.908 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-18T03:21:17.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-18T03:21:17.065 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:21:17.065 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-18T03:21:17.121 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:21:17.121 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:21:17.121 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:21:17.121 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:21:17.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-18T03:21:17.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:17.268 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-18T03:21:17.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-18T03:21:17.424 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:21:17.424 DEBUG:teuthology.orchestra.run.trial014:> uname -r 2026-02-18T03:21:17.481 INFO:teuthology.orchestra.run.trial014.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:21:17.481 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:21:17.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:21:17.482 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:21:18.122 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-18T03:21:18.122 DEBUG:teuthology.orchestra.run.trial086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:21:18.156 INFO:teuthology.orchestra.run.trial086.stdout:ttyS1 2026-02-18T03:21:18.179 DEBUG:teuthology.parallel:result is None 2026-02-18T03:21:18.482 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2026-02-18T03:21:18.483 DEBUG:teuthology.orchestra.run.trial014:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:21:18.512 INFO:teuthology.orchestra.run.trial014.stdout:ttyS1 2026-02-18T03:21:18.542 DEBUG:teuthology.parallel:result is None 2026-02-18T03:21:19.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-18T03:21:19.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:19.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-18T03:21:19.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:21:19.254 DEBUG:teuthology.orchestra.run.trial177:> true 2026-02-18T03:21:19.337 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-18T03:21:19.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-18T03:21:19.408 INFO:teuthology.task.kernel:Checking kernel version of host.d, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:21:19.408 DEBUG:teuthology.orchestra.run.trial177:> uname -r 2026-02-18T03:21:19.464 INFO:teuthology.orchestra.run.trial177.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:21:19.464 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:21:19.464 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:21:19.464 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:21:19.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-18T03:21:19.490 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.14.0-681.el9.x86_64"... 2026-02-18T03:21:19.490 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-18T03:21:19.545 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-18T03:21:19.545 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T03:21:19.545 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T03:21:19.545 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T03:21:20.465 INFO:teuthology.task.kernel:Enabling kdb on host.d... 2026-02-18T03:21:20.466 DEBUG:teuthology.orchestra.run.trial177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:21:20.496 INFO:teuthology.orchestra.run.trial177.stdout:ttyS1 2026-02-18T03:21:20.521 DEBUG:teuthology.parallel:result is None 2026-02-18T03:21:20.546 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2026-02-18T03:21:20.547 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T03:21:20.576 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-18T03:21:20.603 DEBUG:teuthology.parallel:result is None 2026-02-18T03:21:20.603 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T03:21:20.616 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T03:21:20.616 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:21:20.619 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:21:20.622 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:21:20.624 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:21:20.645 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T03:21:20.664 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T03:21:20.675 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T03:21:20.688 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T03:21:20.688 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:21:20.691 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:21:20.693 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:21:20.696 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:21:20.703 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T03:21:20.730 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T03:21:20.743 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T03:21:20.743 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:21:20.749 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:21:20.751 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:21:20.753 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:21:20.760 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T03:21:20.770 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.773 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.776 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.780 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.782 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.783 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.785 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.787 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.792 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.795 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T03:21:20.797 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T03:21:20.808 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T03:21:20.809 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:21:20.824 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:21:20.826 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:21:20.829 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:21:20.836 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T03:21:20.862 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T03:21:20.878 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T03:21:20.878 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:21:20.889 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:21:20.892 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:21:20.895 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:21:20.900 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T03:21:20.919 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:21.059 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:21.084 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:21.228 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:21.254 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:21:21.254 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:21:21.318 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:21.430 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:21.455 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:21.846 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:21.871 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:21:21.871 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:21:21.935 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.071 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.097 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.240 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.264 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:21:22.264 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:21:22.326 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.425 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.450 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.593 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.617 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:21:22.617 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:21:22.682 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.798 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T03:21:22.823 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.971 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T03:21:22.994 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:21:22.994 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T03:21:23.059 DEBUG:teuthology.orchestra.run.trial014:> sudo service rsyslog restart 2026-02-18T03:21:23.062 DEBUG:teuthology.orchestra.run.trial034:> sudo service rsyslog restart 2026-02-18T03:21:23.065 DEBUG:teuthology.orchestra.run.trial086:> sudo service rsyslog restart 2026-02-18T03:21:23.068 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-18T03:21:23.070 DEBUG:teuthology.orchestra.run.trial177:> sudo service rsyslog restart 2026-02-18T03:21:23.089 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:21:23.092 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:21:23.094 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:21:23.097 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:21:23.127 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T03:21:23.551 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T03:21:23.566 INFO:teuthology.task.internal:Starting timer... 2026-02-18T03:21:23.567 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T03:21:23.588 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T03:21:23.606 DEBUG:teuthology.orchestra.run.trial014:> sudo service auditd rotate 2026-02-18T03:21:23.635 INFO:teuthology.orchestra.run.trial014.stdout:Rotating logs: 2026-02-18T03:21:23.637 DEBUG:teuthology.orchestra.run.trial034:> sudo service auditd rotate 2026-02-18T03:21:23.666 INFO:teuthology.orchestra.run.trial034.stdout:Rotating logs: 2026-02-18T03:21:23.668 DEBUG:teuthology.orchestra.run.trial086:> sudo service auditd rotate 2026-02-18T03:21:23.698 INFO:teuthology.orchestra.run.trial086.stdout:Rotating logs: 2026-02-18T03:21:23.700 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-18T03:21:23.730 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-18T03:21:23.731 DEBUG:teuthology.orchestra.run.trial177:> sudo service auditd rotate 2026-02-18T03:21:23.760 INFO:teuthology.orchestra.run.trial177.stdout:Rotating logs: 2026-02-18T03:21:23.762 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T03:21:23.763 DEBUG:teuthology.orchestra.run.trial014:> /usr/sbin/getenforce 2026-02-18T03:21:23.780 INFO:teuthology.orchestra.run.trial014.stdout:Permissive 2026-02-18T03:21:23.781 DEBUG:teuthology.orchestra.run.trial034:> /usr/sbin/getenforce 2026-02-18T03:21:23.798 INFO:teuthology.orchestra.run.trial034.stdout:Permissive 2026-02-18T03:21:23.799 DEBUG:teuthology.orchestra.run.trial086:> /usr/sbin/getenforce 2026-02-18T03:21:23.816 INFO:teuthology.orchestra.run.trial086.stdout:Permissive 2026-02-18T03:21:23.817 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-18T03:21:23.834 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-18T03:21:23.834 DEBUG:teuthology.orchestra.run.trial177:> /usr/sbin/getenforce 2026-02-18T03:21:23.851 INFO:teuthology.orchestra.run.trial177.stdout:Permissive 2026-02-18T03:21:23.852 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial014.front.sepia.ceph.com': 'permissive', 'ubuntu@trial034.front.sepia.ceph.com': 'permissive', 'ubuntu@trial086.front.sepia.ceph.com': 'permissive', 'ubuntu@trial155.front.sepia.ceph.com': 'permissive', 'ubuntu@trial177.front.sepia.ceph.com': 'permissive'} 2026-02-18T03:21:23.852 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:21:23.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:21:23.879 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:21:23.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:21:23.906 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:21:23.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:21:23.931 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:21:23.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:21:23.957 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T03:21:23.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:21:23.982 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T03:21:23.982 DEBUG:teuthology.orchestra.run.trial014:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:21:24.008 DEBUG:teuthology.orchestra.run.trial034:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:21:24.033 DEBUG:teuthology.orchestra.run.trial086:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:21:24.060 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:21:24.085 DEBUG:teuthology.orchestra.run.trial177:> sudo /usr/sbin/setenforce permissive 2026-02-18T03:21:24.110 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T03:21:24.126 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-18T03:21:24.130 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-18T03:21:24.259 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T03:21:24.272 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T03:21:24.273 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial014.front.sepia.ceph.com,trial034.front.sepia.ceph.com,trial086.front.sepia.ceph.com,trial155.front.sepia.ceph.com,trial177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T03:22:37.923 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial014.front.sepia.ceph.com'), Remote(name='ubuntu@trial034.front.sepia.ceph.com'), Remote(name='ubuntu@trial086.front.sepia.ceph.com'), Remote(name='ubuntu@trial155.front.sepia.ceph.com'), Remote(name='ubuntu@trial177.front.sepia.ceph.com')] 2026-02-18T03:22:37.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-18T03:22:37.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:22:38.053 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-18T03:22:38.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-18T03:22:38.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-18T03:22:38.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:22:38.244 DEBUG:teuthology.orchestra.run.trial034:> true 2026-02-18T03:22:38.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-18T03:22:38.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-18T03:22:38.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:22:38.404 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-18T03:22:38.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-18T03:22:38.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-18T03:22:38.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:22:38.564 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-18T03:22:38.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-18T03:22:38.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-18T03:22:38.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T03:22:38.729 DEBUG:teuthology.orchestra.run.trial177:> true 2026-02-18T03:22:38.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-18T03:22:38.804 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T03:22:38.819 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T03:22:38.819 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:22:38.821 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:22:38.824 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:22:38.824 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:22:38.827 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:22:38.827 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:22:38.830 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:22:38.831 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:22:38.833 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T03:22:38.834 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T03:22:38.849 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:22:38.853 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:22:38.856 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:22:38.858 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:22:38.861 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:22:38.865 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:22:38.867 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:22:38.870 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:22:38.872 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T03:22:38.882 INFO:teuthology.orchestra.run.trial014.stderr:sudo: ntpd: command not found 2026-02-18T03:22:38.884 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T03:22:38.885 INFO:teuthology.orchestra.run.trial034.stderr:sudo: ntpd: command not found 2026-02-18T03:22:38.887 INFO:teuthology.orchestra.run.trial086.stderr:sudo: ntpd: command not found 2026-02-18T03:22:38.889 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-18T03:22:38.892 INFO:teuthology.orchestra.run.trial014.stdout:506 Cannot talk to daemon 2026-02-18T03:22:38.895 INFO:teuthology.orchestra.run.trial034.stdout:506 Cannot talk to daemon 2026-02-18T03:22:38.897 INFO:teuthology.orchestra.run.trial086.stdout:506 Cannot talk to daemon 2026-02-18T03:22:38.899 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-18T03:22:38.904 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:22:38.905 INFO:teuthology.orchestra.run.trial177.stderr:sudo: ntpd: command not found 2026-02-18T03:22:38.906 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:22:38.908 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:22:38.910 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:22:38.914 INFO:teuthology.orchestra.run.trial177.stdout:506 Cannot talk to daemon 2026-02-18T03:22:38.916 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:22:38.918 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:22:38.919 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:22:38.920 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:22:38.926 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T03:22:38.938 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T03:22:38.960 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:22:38.961 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:22:38.962 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:22:38.962 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-18T03:22:38.962 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:22:38.964 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:22:38.964 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-18T03:22:38.965 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:22:38.966 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-18T03:22:38.966 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:22:38.967 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:22:38.967 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-18T03:22:38.989 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-18T03:22:38.991 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T03:22:38.991 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-18T03:22:38.992 INFO:teuthology.run_tasks:Running task install... 2026-02-18T03:22:39.006 DEBUG:teuthology.task.install:project ceph 2026-02-18T03:22:39.006 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'}} 2026-02-18T03:22:39.006 DEBUG:teuthology.task.install:config {'extra_packages': ['nvme-cli'], 'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T03:22:39.007 INFO:teuthology.task.install:Using flavor: default 2026-02-18T03:22:39.015 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T03:22:39.016 INFO:teuthology.task.install:extra packages: ['nvme-cli'] 2026-02-18T03:22:39.017 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:22:39.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:22:39.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:22:39.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:22:39.024 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:22:39.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:22:39.026 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:22:39.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:22:39.028 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T03:22:39.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:22:39.328 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:22:39.328 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:22:39.331 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:22:39.331 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:22:39.331 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:22:39.331 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:22:39.333 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:22:39.334 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:22:39.334 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T03:22:39.334 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T03:22:39.599 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:22:39.600 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:22:39.600 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:22:39.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:22:39.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:22:39.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:22:39.604 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:22:39.607 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T03:22:39.607 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:22:39.607 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T03:22:39.629 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:22:39.629 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:22:39.629 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:22:39.630 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:22:39.630 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:22:39.630 DEBUG:teuthology.orchestra.run.trial034:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:22:39.630 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:22:39.630 DEBUG:teuthology.orchestra.run.trial177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:22:39.632 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2026-02-18T03:22:39.632 DEBUG:teuthology.orchestra.run.trial014:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T03:22:39.693 DEBUG:teuthology.orchestra.run.trial034:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:22:39.694 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:22:39.694 DEBUG:teuthology.orchestra.run.trial177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:22:39.695 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:22:39.696 DEBUG:teuthology.orchestra.run.trial014:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T03:22:39.767 DEBUG:teuthology.orchestra.run.trial034:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:22:39.769 DEBUG:teuthology.orchestra.run.trial177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:22:39.770 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:22:39.771 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:22:39.773 DEBUG:teuthology.orchestra.run.trial014:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T03:22:39.830 INFO:teuthology.orchestra.run.trial034.stdout:check_obsoletes = 1 2026-02-18T03:22:39.831 DEBUG:teuthology.orchestra.run.trial034:> sudo yum clean all 2026-02-18T03:22:39.833 INFO:teuthology.orchestra.run.trial177.stdout:check_obsoletes = 1 2026-02-18T03:22:39.833 DEBUG:teuthology.orchestra.run.trial177:> sudo yum clean all 2026-02-18T03:22:39.834 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-18T03:22:39.834 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-18T03:22:39.836 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-18T03:22:39.836 INFO:teuthology.orchestra.run.trial014.stdout:check_obsoletes = 1 2026-02-18T03:22:39.837 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-18T03:22:39.838 DEBUG:teuthology.orchestra.run.trial014:> sudo yum clean all 2026-02-18T03:22:39.980 INFO:teuthology.orchestra.run.trial034.stdout:41 files removed 2026-02-18T03:22:39.981 INFO:teuthology.orchestra.run.trial177.stdout:41 files removed 2026-02-18T03:22:39.984 INFO:teuthology.orchestra.run.trial086.stdout:41 files removed 2026-02-18T03:22:39.985 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-18T03:22:39.988 INFO:teuthology.orchestra.run.trial014.stdout:41 files removed 2026-02-18T03:22:39.994 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-radosgw 2026-02-18T03:22:39.996 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-radosgw 2026-02-18T03:22:40.010 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw 2026-02-18T03:22:40.012 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-18T03:22:40.015 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-radosgw 2026-02-18T03:22:40.266 INFO:teuthology.orchestra.run.trial177.stdout:ceph packages for x86_64 699 kB/s | 89 kB 00:00 2026-02-18T03:22:40.277 INFO:teuthology.orchestra.run.trial034.stdout:ceph packages for x86_64 701 kB/s | 89 kB 00:00 2026-02-18T03:22:40.283 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 701 kB/s | 89 kB 00:00 2026-02-18T03:22:40.288 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 691 kB/s | 89 kB 00:00 2026-02-18T03:22:40.290 INFO:teuthology.orchestra.run.trial014.stdout:ceph packages for x86_64 698 kB/s | 89 kB 00:00 2026-02-18T03:22:40.402 INFO:teuthology.orchestra.run.trial177.stdout:ceph noarch packages 170 kB/s | 19 kB 00:00 2026-02-18T03:22:40.419 INFO:teuthology.orchestra.run.trial034.stdout:ceph noarch packages 161 kB/s | 19 kB 00:00 2026-02-18T03:22:40.424 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 162 kB/s | 19 kB 00:00 2026-02-18T03:22:40.429 INFO:teuthology.orchestra.run.trial014.stdout:ceph noarch packages 168 kB/s | 19 kB 00:00 2026-02-18T03:22:40.434 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 159 kB/s | 19 kB 00:00 2026-02-18T03:22:40.528 INFO:teuthology.orchestra.run.trial177.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-18T03:22:40.542 INFO:teuthology.orchestra.run.trial034.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:22:40.548 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:22:40.554 INFO:teuthology.orchestra.run.trial014.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:22:40.560 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T03:22:41.361 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-18T03:22:41.371 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-18T03:22:41.485 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.9 MB 00:00 2026-02-18T03:22:42.350 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - AppStream 81 MB/s | 27 MB 00:00 2026-02-18T03:22:42.448 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - AppStream 48 MB/s | 27 MB 00:00 2026-02-18T03:22:43.202 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.9 MB 00:02 2026-02-18T03:22:44.655 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-18T03:22:45.105 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - CRB 28 MB/s | 7.8 MB 00:00 2026-02-18T03:22:46.152 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 20 kB 00:00 2026-02-18T03:22:46.308 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.9 MB 00:05 2026-02-18T03:22:46.389 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-18T03:22:46.458 INFO:teuthology.orchestra.run.trial177.stdout:Extra Packages for Enterprise Linux 84 MB/s | 20 MB 00:00 2026-02-18T03:22:46.802 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 7.8 MB 00:02 2026-02-18T03:22:47.497 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 16 MB/s | 7.8 MB 00:00 2026-02-18T03:22:47.650 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - Extras packages 178 kB/s | 20 kB 00:00 2026-02-18T03:22:48.639 INFO:teuthology.orchestra.run.trial014.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-18T03:22:49.117 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 23 MB/s | 7.8 MB 00:00 2026-02-18T03:22:49.328 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-18T03:22:49.336 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-18T03:22:49.684 INFO:teuthology.orchestra.run.trial177.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-18T03:22:50.637 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-18T03:22:50.842 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-18T03:22:50.914 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repository Size 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout:Upgrading: 2026-02-18T03:22:50.916 INFO:teuthology.orchestra.run.trial177.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:22:50.917 INFO:teuthology.orchestra.run.trial177.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:22:50.918 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout:Installing weak dependencies: 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:22:50.919 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout:Install 35 Packages 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout:Upgrade 2 Packages 2026-02-18T03:22:50.920 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:22:50.921 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 79 M 2026-02-18T03:22:50.921 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:22:51.028 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 62 MB/s | 20 MB 00:00 2026-02-18T03:22:51.888 INFO:teuthology.orchestra.run.trial014.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-18T03:22:52.560 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 7.8 MB 00:00 2026-02-18T03:22:53.116 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:22:53.118 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout:Upgrading: 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:22:53.119 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:22:53.120 INFO:teuthology.orchestra.run.trial014.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:22:53.121 INFO:teuthology.orchestra.run.trial014.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout:Installing weak dependencies: 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:22:53.122 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:22:53.123 INFO:teuthology.orchestra.run.trial014.stdout:Install 35 Packages 2026-02-18T03:22:53.123 INFO:teuthology.orchestra.run.trial014.stdout:Upgrade 2 Packages 2026-02-18T03:22:53.123 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:22:53.123 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 79 M 2026-02-18T03:22:53.124 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:22:54.064 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-18T03:22:54.220 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-18T03:22:54.307 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-18T03:22:54.579 INFO:teuthology.orchestra.run.trial177.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 1.8 MB/s | 5.9 MB 00:03 2026-02-18T03:22:54.635 INFO:teuthology.orchestra.run.trial177.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 449 kB/s | 25 kB 00:00 2026-02-18T03:22:54.692 INFO:teuthology.orchestra.run.trial177.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 619 kB/s | 35 kB 00:00 2026-02-18T03:22:54.752 INFO:teuthology.orchestra.run.trial177.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 405 kB/s | 24 kB 00:00 2026-02-18T03:22:55.129 INFO:teuthology.orchestra.run.trial177.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 2.3 MB/s | 869 kB 00:00 2026-02-18T03:22:55.257 INFO:teuthology.orchestra.run.trial177.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 1.9 MB/s | 250 kB 00:00 2026-02-18T03:22:55.275 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:22:55.277 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:22:55.277 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-18T03:22:55.277 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:22:55.277 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:22:55.277 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout:Upgrading: 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:22:55.278 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:22:55.279 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:22:55.280 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout:Install 35 Packages 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout:Upgrade 2 Packages 2026-02-18T03:22:55.281 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:22:55.282 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 79 M 2026-02-18T03:22:55.282 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:22:55.438 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:22:55.440 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-18T03:22:55.441 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:22:55.442 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:22:55.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:22:55.444 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:22:55.445 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:22:55.445 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:22:55.445 INFO:teuthology.orchestra.run.trial155.stdout:Install 35 Packages 2026-02-18T03:22:55.445 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-18T03:22:55.445 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:22:55.446 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 79 M 2026-02-18T03:22:55.446 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:22:55.734 INFO:teuthology.orchestra.run.trial014.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 4.0 MB/s | 5.9 MB 00:01 2026-02-18T03:22:55.774 INFO:teuthology.orchestra.run.trial014.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 614 kB/s | 25 kB 00:00 2026-02-18T03:22:55.815 INFO:teuthology.orchestra.run.trial014.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 864 kB/s | 35 kB 00:00 2026-02-18T03:22:55.858 INFO:teuthology.orchestra.run.trial014.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 569 kB/s | 24 kB 00:00 2026-02-18T03:22:56.030 INFO:teuthology.orchestra.run.trial014.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 4.9 MB/s | 869 kB 00:00 2026-02-18T03:22:56.090 INFO:teuthology.orchestra.run.trial014.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 4.0 MB/s | 250 kB 00:00 2026-02-18T03:22:56.102 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2026-02-18T03:22:56.620 INFO:teuthology.orchestra.run.trial177.stdout:(7/37): ceph-radosgw-20.2.0-670.gadc19233.el9.x 4.5 MB/s | 24 MB 00:05 2026-02-18T03:22:56.670 INFO:teuthology.orchestra.run.trial177.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 906 kB/s | 45 kB 00:00 2026-02-18T03:22:56.699 INFO:teuthology.orchestra.run.trial034.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 4.9 MB/s | 5.9 MB 00:01 2026-02-18T03:22:56.719 INFO:teuthology.orchestra.run.trial177.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 3.5 MB/s | 175 kB 00:00 2026-02-18T03:22:56.744 INFO:teuthology.orchestra.run.trial034.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 564 kB/s | 25 kB 00:00 2026-02-18T03:22:56.766 INFO:teuthology.orchestra.run.trial177.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 3.4 MB/s | 162 kB 00:00 2026-02-18T03:22:56.789 INFO:teuthology.orchestra.run.trial034.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 784 kB/s | 35 kB 00:00 2026-02-18T03:22:56.840 INFO:teuthology.orchestra.run.trial034.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 476 kB/s | 24 kB 00:00 2026-02-18T03:22:56.857 INFO:teuthology.orchestra.run.trial177.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 3.5 MB/s | 323 kB 00:00 2026-02-18T03:22:56.960 INFO:teuthology.orchestra.run.trial177.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 2.9 MB/s | 305 kB 00:00 2026-02-18T03:22:56.988 INFO:teuthology.orchestra.run.trial014.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 7.1 MB/s | 6.4 MB 00:00 2026-02-18T03:22:56.998 INFO:teuthology.orchestra.run.trial034.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 5.4 MB/s | 869 kB 00:00 2026-02-18T03:22:57.013 INFO:teuthology.orchestra.run.trial177.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 1.9 MB/s | 99 kB 00:00 2026-02-18T03:22:57.033 INFO:teuthology.orchestra.run.trial014.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.0 MB/s | 45 kB 00:00 2026-02-18T03:22:57.039 INFO:teuthology.orchestra.run.trial177.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-18T03:22:57.044 INFO:teuthology.orchestra.run.trial034.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 5.3 MB/s | 250 kB 00:00 2026-02-18T03:22:57.077 INFO:teuthology.orchestra.run.trial014.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 3.8 MB/s | 175 kB 00:00 2026-02-18T03:22:57.081 INFO:teuthology.orchestra.run.trial177.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 27 MB/s | 1.1 MB 00:00 2026-02-18T03:22:57.090 INFO:teuthology.orchestra.run.trial177.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.7 MB/s | 93 kB 00:00 2026-02-18T03:22:57.124 INFO:teuthology.orchestra.run.trial014.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 3.4 MB/s | 162 kB 00:00 2026-02-18T03:22:57.176 INFO:teuthology.orchestra.run.trial014.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 6.2 MB/s | 323 kB 00:00 2026-02-18T03:22:57.228 INFO:teuthology.orchestra.run.trial014.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 5.8 MB/s | 305 kB 00:00 2026-02-18T03:22:57.275 INFO:teuthology.orchestra.run.trial014.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 2.0 MB/s | 99 kB 00:00 2026-02-18T03:22:57.313 INFO:teuthology.orchestra.run.trial014.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 878 kB/s | 33 kB 00:00 2026-02-18T03:22:57.361 INFO:teuthology.orchestra.run.trial014.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 23 MB/s | 1.1 MB 00:00 2026-02-18T03:22:57.370 INFO:teuthology.orchestra.run.trial014.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.6 MB/s | 93 kB 00:00 2026-02-18T03:22:57.438 INFO:teuthology.orchestra.run.trial014.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-18T03:22:57.449 INFO:teuthology.orchestra.run.trial177.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 290 kB/s | 104 kB 00:00 2026-02-18T03:22:57.497 INFO:teuthology.orchestra.run.trial014.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2026-02-18T03:22:57.562 INFO:teuthology.orchestra.run.trial014.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2026-02-18T03:22:57.611 INFO:teuthology.orchestra.run.trial014.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 935 kB/s | 45 kB 00:00 2026-02-18T03:22:57.696 INFO:teuthology.orchestra.run.trial014.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 7.6 MB/s | 662 kB 00:00 2026-02-18T03:22:57.729 INFO:teuthology.orchestra.run.trial177.stdout:(18/37): librgw2-20.2.0-670.gadc19233.el9.x86_6 2.6 MB/s | 6.4 MB 00:02 2026-02-18T03:22:57.763 INFO:teuthology.orchestra.run.trial014.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2026-02-18T03:22:57.829 INFO:teuthology.orchestra.run.trial014.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 3.5 MB/s | 240 kB 00:00 2026-02-18T03:22:57.865 INFO:teuthology.orchestra.run.trial177.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 393 kB/s | 164 kB 00:00 2026-02-18T03:22:57.883 INFO:teuthology.orchestra.run.trial014.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 697 kB/s | 37 kB 00:00 2026-02-18T03:22:57.932 INFO:teuthology.orchestra.run.trial014.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.3 MB/s | 66 kB 00:00 2026-02-18T03:22:58.002 INFO:teuthology.orchestra.run.trial034.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 6.6 MB/s | 6.4 MB 00:00 2026-02-18T03:22:58.039 INFO:teuthology.orchestra.run.trial034.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.2 MB/s | 45 kB 00:00 2026-02-18T03:22:58.078 INFO:teuthology.orchestra.run.trial034.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 4.3 MB/s | 175 kB 00:00 2026-02-18T03:22:58.115 INFO:teuthology.orchestra.run.trial177.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 181 kB/s | 45 kB 00:00 2026-02-18T03:22:58.118 INFO:teuthology.orchestra.run.trial034.stdout:(10/37): python3-cephfs-20.2.0-670.gadc19233.el 4.0 MB/s | 162 kB 00:00 2026-02-18T03:22:58.141 INFO:teuthology.orchestra.run.trial177.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 389 kB/s | 160 kB 00:00 2026-02-18T03:22:58.200 INFO:teuthology.orchestra.run.trial034.stdout:(11/37): python3-rados-20.2.0-670.gadc19233.el9 3.9 MB/s | 323 kB 00:00 2026-02-18T03:22:58.245 INFO:teuthology.orchestra.run.trial034.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 6.7 MB/s | 305 kB 00:00 2026-02-18T03:22:58.285 INFO:teuthology.orchestra.run.trial034.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 2.4 MB/s | 99 kB 00:00 2026-02-18T03:22:58.312 INFO:teuthology.orchestra.run.trial034.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-18T03:22:58.354 INFO:teuthology.orchestra.run.trial034.stdout:(15/37): nvme-cli-2.13-1.el9.x86_64.rpm 26 MB/s | 1.1 MB 00:00 2026-02-18T03:22:58.358 INFO:teuthology.orchestra.run.trial014.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 723 kB/s | 308 kB 00:00 2026-02-18T03:22:58.363 INFO:teuthology.orchestra.run.trial034.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.6 MB/s | 93 kB 00:00 2026-02-18T03:22:58.440 INFO:teuthology.orchestra.run.trial034.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.3 MB/s | 104 kB 00:00 2026-02-18T03:22:58.472 INFO:teuthology.orchestra.run.trial034.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 5.0 MB/s | 164 kB 00:00 2026-02-18T03:22:58.504 INFO:teuthology.orchestra.run.trial034.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.0 MB/s | 160 kB 00:00 2026-02-18T03:22:58.532 INFO:teuthology.orchestra.run.trial034.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.6 MB/s | 45 kB 00:00 2026-02-18T03:22:58.575 INFO:teuthology.orchestra.run.trial034.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 662 kB 00:00 2026-02-18T03:22:58.606 INFO:teuthology.orchestra.run.trial034.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.3 MB/s | 292 kB 00:00 2026-02-18T03:22:58.641 INFO:teuthology.orchestra.run.trial034.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 6.9 MB/s | 240 kB 00:00 2026-02-18T03:22:58.670 INFO:teuthology.orchestra.run.trial034.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.2 MB/s | 37 kB 00:00 2026-02-18T03:22:58.686 INFO:teuthology.orchestra.run.trial177.stdout:(22/37): ceph-common-20.2.0-670.gadc19233.el9.x 3.3 MB/s | 24 MB 00:07 2026-02-18T03:22:58.695 INFO:teuthology.orchestra.run.trial034.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.6 MB/s | 66 kB 00:00 2026-02-18T03:22:58.733 INFO:teuthology.orchestra.run.trial177.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 494 kB/s | 292 kB 00:00 2026-02-18T03:22:58.942 INFO:teuthology.orchestra.run.trial034.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-18T03:22:58.966 INFO:teuthology.orchestra.run.trial177.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 159 kB/s | 37 kB 00:00 2026-02-18T03:22:58.978 INFO:teuthology.orchestra.run.trial155.stdout:(1/37): ceph-radosgw-20.2.0-670.gadc19233.el9.x 7.8 MB/s | 24 MB 00:03 2026-02-18T03:22:59.000 INFO:teuthology.orchestra.run.trial155.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 1.2 MB/s | 25 kB 00:00 2026-02-18T03:22:59.014 INFO:teuthology.orchestra.run.trial014.stdout:(27/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 5.0 MB/s | 24 MB 00:04 2026-02-18T03:22:59.021 INFO:teuthology.orchestra.run.trial155.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 1.7 MB/s | 35 kB 00:00 2026-02-18T03:22:59.045 INFO:teuthology.orchestra.run.trial155.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 1.0 MB/s | 24 kB 00:00 2026-02-18T03:22:59.085 INFO:teuthology.orchestra.run.trial155.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 21 MB/s | 869 kB 00:00 2026-02-18T03:22:59.087 INFO:teuthology.orchestra.run.trial177.stdout:(25/37): librdkafka-1.6.1-102.el9.x86_64.rpm 681 kB/s | 662 kB 00:00 2026-02-18T03:22:59.115 INFO:teuthology.orchestra.run.trial155.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 8.2 MB/s | 250 kB 00:00 2026-02-18T03:22:59.134 INFO:teuthology.orchestra.run.trial034.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2026-02-18T03:22:59.195 INFO:teuthology.orchestra.run.trial034.stdout:(28/37): ceph-common-20.2.0-670.gadc19233.el9.x 6.4 MB/s | 24 MB 00:03 2026-02-18T03:22:59.195 INFO:teuthology.orchestra.run.trial034.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 408 kB/s | 25 kB 00:00 2026-02-18T03:22:59.197 INFO:teuthology.orchestra.run.trial177.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 469 kB/s | 240 kB 00:00 2026-02-18T03:22:59.204 INFO:teuthology.orchestra.run.trial177.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2026-02-18T03:22:59.221 INFO:teuthology.orchestra.run.trial177.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.5 MB/s | 25 kB 00:00 2026-02-18T03:22:59.225 INFO:teuthology.orchestra.run.trial014.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 117 kB/s | 25 kB 00:00 2026-02-18T03:22:59.231 INFO:teuthology.orchestra.run.trial034.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-18T03:22:59.238 INFO:teuthology.orchestra.run.trial177.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2026-02-18T03:22:59.240 INFO:teuthology.orchestra.run.trial177.stdout:(30/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 242 kB/s | 66 kB 00:00 2026-02-18T03:22:59.249 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T03:22:59.255 INFO:teuthology.orchestra.run.trial177.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.8 MB/s | 67 kB 00:00 2026-02-18T03:22:59.271 INFO:teuthology.orchestra.run.trial034.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2026-02-18T03:22:59.288 INFO:teuthology.orchestra.run.trial177.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 5.8 MB/s | 191 kB 00:00 2026-02-18T03:22:59.307 INFO:teuthology.orchestra.run.trial034.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 5.2 MB/s | 191 kB 00:00 2026-02-18T03:22:59.331 INFO:teuthology.orchestra.run.trial155.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 29 MB/s | 6.4 MB 00:00 2026-02-18T03:22:59.345 INFO:teuthology.orchestra.run.trial155.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 3.3 MB/s | 45 kB 00:00 2026-02-18T03:22:59.350 INFO:teuthology.orchestra.run.trial177.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 26 MB/s | 1.6 MB 00:00 2026-02-18T03:22:59.361 INFO:teuthology.orchestra.run.trial155.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 11 MB/s | 175 kB 00:00 2026-02-18T03:22:59.368 INFO:teuthology.orchestra.run.trial155.stdout:(10/37): ceph-base-20.2.0-670.gadc19233.el9.x86 1.7 MB/s | 5.9 MB 00:03 2026-02-18T03:22:59.369 INFO:teuthology.orchestra.run.trial034.stdout:(33/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 6.1 MB/s | 24 MB 00:03 2026-02-18T03:22:59.369 INFO:teuthology.orchestra.run.trial034.stdout:(34/37): liboath-2.6.12-1.el9.x86_64.rpm 282 kB/s | 49 kB 00:00 2026-02-18T03:22:59.373 INFO:teuthology.orchestra.run.trial177.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 838 kB 00:00 2026-02-18T03:22:59.374 INFO:teuthology.orchestra.run.trial155.stdout:(11/37): python3-cephfs-20.2.0-670.gadc19233.el 12 MB/s | 162 kB 00:00 2026-02-18T03:22:59.374 INFO:teuthology.orchestra.run.trial034.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2026-02-18T03:22:59.375 INFO:teuthology.orchestra.run.trial014.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2026-02-18T03:22:59.379 INFO:teuthology.orchestra.run.trial177.stdout:(35/37): libarrow-9.0.0-15.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2026-02-18T03:22:59.393 INFO:teuthology.orchestra.run.trial155.stdout:(12/37): python3-rbd-20.2.0-670.gadc19233.el9.x 15 MB/s | 305 kB 00:00 2026-02-18T03:22:59.416 INFO:teuthology.orchestra.run.trial155.stdout:(13/37): python3-rgw-20.2.0-670.gadc19233.el9.x 4.4 MB/s | 99 kB 00:00 2026-02-18T03:22:59.445 INFO:teuthology.orchestra.run.trial155.stdout:(14/37): python3-rados-20.2.0-670.gadc19233.el9 4.1 MB/s | 323 kB 00:00 2026-02-18T03:22:59.510 INFO:teuthology.orchestra.run.trial155.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 352 kB/s | 33 kB 00:00 2026-02-18T03:22:59.511 INFO:teuthology.orchestra.run.trial014.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 171 kB/s | 49 kB 00:00 2026-02-18T03:22:59.578 INFO:teuthology.orchestra.run.trial155.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-18T03:22:59.594 INFO:teuthology.orchestra.run.trial034.stdout:(36/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 13 MB/s | 2.8 MB 00:00 2026-02-18T03:22:59.653 INFO:teuthology.orchestra.run.trial155.stdout:(17/37): nvme-cli-2.13-1.el9.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2026-02-18T03:22:59.664 INFO:teuthology.orchestra.run.trial014.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 233 kB/s | 67 kB 00:00 2026-02-18T03:22:59.719 INFO:teuthology.orchestra.run.trial034.stdout:(37/37): librados2-20.2.0-670.gadc19233.el9.x86 10 MB/s | 3.5 MB 00:00 2026-02-18T03:22:59.721 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:22:59.721 INFO:teuthology.orchestra.run.trial034.stdout:Total 18 MB/s | 79 MB 00:04 2026-02-18T03:22:59.757 INFO:teuthology.orchestra.run.trial177.stdout:(36/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 7.4 MB/s | 2.8 MB 00:00 2026-02-18T03:22:59.788 INFO:teuthology.orchestra.run.trial014.stdout:(32/37): ceph-common-20.2.0-670.gadc19233.el9.x 4.3 MB/s | 24 MB 00:05 2026-02-18T03:22:59.819 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:22:59.837 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:22:59.838 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:22:59.862 INFO:teuthology.orchestra.run.trial177.stdout:(37/37): librados2-20.2.0-670.gadc19233.el9.x86 6.9 MB/s | 3.5 MB 00:00 2026-02-18T03:22:59.864 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:22:59.864 INFO:teuthology.orchestra.run.trial177.stdout:Total 8.8 MB/s | 79 MB 00:08 2026-02-18T03:22:59.965 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:22:59.985 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:22:59.985 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:00.008 INFO:teuthology.orchestra.run.trial155.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 242 kB/s | 104 kB 00:00 2026-02-18T03:23:00.016 INFO:teuthology.orchestra.run.trial014.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 544 kB/s | 191 kB 00:00 2026-02-18T03:23:00.019 INFO:teuthology.orchestra.run.trial014.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2026-02-18T03:23:00.107 INFO:teuthology.orchestra.run.trial155.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 361 kB/s | 164 kB 00:00 2026-02-18T03:23:00.135 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:00.135 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:00.185 INFO:teuthology.orchestra.run.trial155.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 901 kB/s | 160 kB 00:00 2026-02-18T03:23:00.200 INFO:teuthology.orchestra.run.trial155.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 486 kB/s | 45 kB 00:00 2026-02-18T03:23:00.211 INFO:teuthology.orchestra.run.trial014.stdout:(35/37): librados2-20.2.0-670.gadc19233.el9.x86 18 MB/s | 3.5 MB 00:00 2026-02-18T03:23:00.218 INFO:teuthology.orchestra.run.trial014.stdout:(36/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 14 MB/s | 2.8 MB 00:00 2026-02-18T03:23:00.283 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:00.283 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:00.378 INFO:teuthology.orchestra.run.trial155.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2026-02-18T03:23:00.419 INFO:teuthology.orchestra.run.trial014.stdout:(37/37): thrift-0.15.0-4.el9.x86_64.rpm 2.5 MB/s | 1.6 MB 00:00 2026-02-18T03:23:00.423 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:00.423 INFO:teuthology.orchestra.run.trial014.stdout:Total 11 MB/s | 79 MB 00:07 2026-02-18T03:23:00.427 INFO:teuthology.orchestra.run.trial155.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2026-02-18T03:23:00.470 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout:Upgrading: 2026-02-18T03:23:00.472 INFO:teuthology.orchestra.run.trial086.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T03:23:00.473 INFO:teuthology.orchestra.run.trial086.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T03:23:00.474 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T03:23:00.475 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:00.476 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:00.476 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:00.476 INFO:teuthology.orchestra.run.trial086.stdout:Install 35 Packages 2026-02-18T03:23:00.476 INFO:teuthology.orchestra.run.trial086.stdout:Upgrade 2 Packages 2026-02-18T03:23:00.476 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:00.477 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:00.477 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 79 M 2026-02-18T03:23:00.477 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:00.484 INFO:teuthology.orchestra.run.trial155.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.2 MB/s | 240 kB 00:00 2026-02-18T03:23:00.485 INFO:teuthology.orchestra.run.trial034.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:23:00.507 INFO:teuthology.orchestra.run.trial155.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 464 kB/s | 37 kB 00:00 2026-02-18T03:23:00.527 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:00.545 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:00.546 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:00.570 INFO:teuthology.orchestra.run.trial155.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 775 kB/s | 66 kB 00:00 2026-02-18T03:23:00.622 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:00.634 INFO:teuthology.orchestra.run.trial177.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:23:00.637 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:23:00.641 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:00.689 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:00.690 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:00.700 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:00.700 INFO:teuthology.orchestra.run.trial155.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-18T03:23:00.702 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:00.703 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:00.728 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:00.730 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:00.738 INFO:teuthology.orchestra.run.trial034.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:23:00.741 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:23:00.744 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:23:00.748 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:23:00.758 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:23:00.770 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:00.771 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:00.784 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:00.786 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:23:00.787 INFO:teuthology.orchestra.run.trial155.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 288 kB/s | 25 kB 00:00 2026-02-18T03:23:00.792 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:00.800 INFO:teuthology.orchestra.run.trial155.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2026-02-18T03:23:00.811 INFO:teuthology.orchestra.run.trial155.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-18T03:23:00.816 INFO:teuthology.orchestra.run.trial034.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:23:00.819 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:23:00.824 INFO:teuthology.orchestra.run.trial155.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-18T03:23:00.826 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:23:00.828 INFO:teuthology.orchestra.run.trial034.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:23:00.832 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:23:00.839 INFO:teuthology.orchestra.run.trial155.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-18T03:23:00.841 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:00.841 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:00.841 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:00.842 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:00.850 INFO:teuthology.orchestra.run.trial155.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2026-02-18T03:23:00.855 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:00.859 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:00.860 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:00.872 INFO:teuthology.orchestra.run.trial155.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 48 MB/s | 1.6 MB 00:00 2026-02-18T03:23:00.886 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:00.888 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:00.896 INFO:teuthology.orchestra.run.trial177.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:23:00.898 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:23:00.901 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:23:00.906 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:23:00.914 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:23:00.926 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:00.927 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:00.939 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:00.957 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:00.958 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:00.970 INFO:teuthology.orchestra.run.trial177.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:23:00.973 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:23:00.981 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:23:00.982 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:00.984 INFO:teuthology.orchestra.run.trial177.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:23:00.984 INFO:teuthology.orchestra.run.trial155.stdout:(35/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 25 MB/s | 2.8 MB 00:00 2026-02-18T03:23:00.985 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:23:00.988 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:23:00.992 INFO:teuthology.orchestra.run.trial034.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:23:01.040 INFO:teuthology.orchestra.run.trial155.stdout:(36/37): ceph-common-20.2.0-670.gadc19233.el9.x 4.7 MB/s | 24 MB 00:05 2026-02-18T03:23:01.111 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:01.112 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:01.139 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:01.142 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:23:01.148 INFO:teuthology.orchestra.run.trial177.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:23:01.180 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:01.191 INFO:teuthology.orchestra.run.trial014.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:23:01.270 INFO:teuthology.orchestra.run.trial034.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:23:01.272 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:01.289 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:01.293 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:23:01.298 INFO:teuthology.orchestra.run.trial034.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:23:01.301 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:23:01.302 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:01.321 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:01.343 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:23:01.348 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:01.348 INFO:teuthology.orchestra.run.trial086.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 15 MB/s | 5.9 MB 00:00 2026-02-18T03:23:01.385 INFO:teuthology.orchestra.run.trial086.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 686 kB/s | 25 kB 00:00 2026-02-18T03:23:01.398 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:01.399 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:01.412 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:01.415 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:01.415 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:01.423 INFO:teuthology.orchestra.run.trial086.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 912 kB/s | 35 kB 00:00 2026-02-18T03:23:01.427 INFO:teuthology.orchestra.run.trial177.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:23:01.428 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:01.433 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:23:01.435 INFO:teuthology.orchestra.run.trial034.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:01.440 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:01.443 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:01.444 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:01.448 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:23:01.450 INFO:teuthology.orchestra.run.trial014.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:23:01.453 INFO:teuthology.orchestra.run.trial177.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:23:01.453 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:23:01.455 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:23:01.456 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:01.456 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:23:01.460 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:23:01.464 INFO:teuthology.orchestra.run.trial086.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 600 kB/s | 24 kB 00:00 2026-02-18T03:23:01.469 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:23:01.474 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:01.481 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:01.482 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:01.495 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:01.523 INFO:teuthology.orchestra.run.trial086.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 14 MB/s | 869 kB 00:00 2026-02-18T03:23:01.527 INFO:teuthology.orchestra.run.trial014.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:23:01.532 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:23:01.538 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:23:01.540 INFO:teuthology.orchestra.run.trial014.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:23:01.545 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:23:01.572 INFO:teuthology.orchestra.run.trial086.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 4.9 MB/s | 250 kB 00:00 2026-02-18T03:23:01.587 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:23:01.589 INFO:teuthology.orchestra.run.trial177.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:01.668 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:01.669 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:01.694 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:01.696 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:23:01.703 INFO:teuthology.orchestra.run.trial014.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:23:01.714 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:01.714 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:23:01.714 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:01.757 INFO:teuthology.orchestra.run.trial034.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:23:01.759 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:23:01.880 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:01.880 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:23:01.881 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:01.915 INFO:teuthology.orchestra.run.trial155.stdout:(37/37): librados2-20.2.0-670.gadc19233.el9.x86 3.3 MB/s | 3.5 MB 00:01 2026-02-18T03:23:01.919 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:01.919 INFO:teuthology.orchestra.run.trial155.stdout:Total 12 MB/s | 79 MB 00:06 2026-02-18T03:23:01.925 INFO:teuthology.orchestra.run.trial177.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:23:01.927 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:23:01.955 INFO:teuthology.orchestra.run.trial086.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 17 MB/s | 6.4 MB 00:00 2026-02-18T03:23:01.983 INFO:teuthology.orchestra.run.trial014.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:23:01.984 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:01.991 INFO:teuthology.orchestra.run.trial086.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.2 MB/s | 45 kB 00:00 2026-02-18T03:23:02.000 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:02.004 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:23:02.008 INFO:teuthology.orchestra.run.trial014.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:23:02.011 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:23:02.012 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:02.019 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:02.030 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:02.037 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:02.037 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:02.038 INFO:teuthology.orchestra.run.trial086.stdout:(9/37): ceph-common-20.2.0-670.gadc19233.el9.x8 22 MB/s | 24 MB 00:01 2026-02-18T03:23:02.039 INFO:teuthology.orchestra.run.trial086.stdout:(10/37): python3-ceph-common-20.2.0-670.gadc192 3.6 MB/s | 175 kB 00:00 2026-02-18T03:23:02.050 INFO:teuthology.orchestra.run.trial086.stdout:(11/37): python3-cephfs-20.2.0-670.gadc19233.el 13 MB/s | 162 kB 00:00 2026-02-18T03:23:02.059 INFO:teuthology.orchestra.run.trial086.stdout:(12/37): python3-rados-20.2.0-670.gadc19233.el9 16 MB/s | 323 kB 00:00 2026-02-18T03:23:02.076 INFO:teuthology.orchestra.run.trial086.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 11 MB/s | 305 kB 00:00 2026-02-18T03:23:02.081 INFO:teuthology.orchestra.run.trial086.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 4.5 MB/s | 99 kB 00:00 2026-02-18T03:23:02.145 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:23:02.148 INFO:teuthology.orchestra.run.trial014.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:02.289 INFO:teuthology.orchestra.run.trial086.stdout:(15/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 18 MB/s | 24 MB 00:01 2026-02-18T03:23:02.334 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:02.334 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:02.340 INFO:teuthology.orchestra.run.trial086.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 126 kB/s | 33 kB 00:00 2026-02-18T03:23:02.385 INFO:teuthology.orchestra.run.trial086.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 2.3 MB/s | 104 kB 00:00 2026-02-18T03:23:02.415 INFO:teuthology.orchestra.run.trial086.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 5.3 MB/s | 164 kB 00:00 2026-02-18T03:23:02.426 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:02.426 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:23:02.426 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:02.444 INFO:teuthology.orchestra.run.trial086.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.4 MB/s | 160 kB 00:00 2026-02-18T03:23:02.467 INFO:teuthology.orchestra.run.trial086.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-18T03:23:02.469 INFO:teuthology.orchestra.run.trial014.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:23:02.472 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:23:02.500 INFO:teuthology.orchestra.run.trial086.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 20 MB/s | 662 kB 00:00 2026-02-18T03:23:02.528 INFO:teuthology.orchestra.run.trial086.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-18T03:23:02.552 INFO:teuthology.orchestra.run.trial086.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.8 MB/s | 240 kB 00:00 2026-02-18T03:23:02.577 INFO:teuthology.orchestra.run.trial086.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-18T03:23:02.601 INFO:teuthology.orchestra.run.trial086.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-02-18T03:23:02.682 INFO:teuthology.orchestra.run.trial086.stdout:(26/37): pciutils-3.7.0-7.el9.x86_64.rpm 238 kB/s | 93 kB 00:00 2026-02-18T03:23:02.684 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:02.696 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:23:02.753 INFO:teuthology.orchestra.run.trial086.stdout:(27/37): nvme-cli-2.13-1.el9.x86_64.rpm 1.6 MB/s | 1.1 MB 00:00 2026-02-18T03:23:02.835 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:02.838 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:02.853 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:23:02.857 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:02.909 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:02.910 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:02.923 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:02.925 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:02.925 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:02.952 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:02.954 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:02.961 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:23:02.963 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:23:02.966 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:23:02.971 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:23:02.979 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:23:02.991 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:02.992 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:03.005 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:03.007 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.010 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.042 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:23:03.046 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:23:03.052 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:23:03.054 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:23:03.059 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:23:03.134 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.137 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.149 INFO:teuthology.orchestra.run.trial086.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 62 kB/s | 25 kB 00:00 2026-02-18T03:23:03.186 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:03.187 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.187 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:23:03.187 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:23:03.187 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:03.188 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:03.189 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:03.212 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:03.215 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:23:03.221 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:23:03.242 INFO:teuthology.orchestra.run.trial086.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 480 kB/s | 308 kB 00:00 2026-02-18T03:23:03.303 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.307 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.307 INFO:teuthology.orchestra.run.trial086.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 312 kB/s | 49 kB 00:00 2026-02-18T03:23:03.321 INFO:teuthology.orchestra.run.trial086.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 851 kB/s | 67 kB 00:00 2026-02-18T03:23:03.348 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.348 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:23:03.348 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:23:03.348 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:03.351 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:03.401 INFO:teuthology.orchestra.run.trial086.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 2.3 MB/s | 191 kB 00:00 2026-02-18T03:23:03.505 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:23:03.506 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:03.522 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:03.527 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:23:03.533 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:23:03.536 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:23:03.536 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:03.553 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.554 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:03.555 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.620 INFO:teuthology.orchestra.run.trial086.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2026-02-18T03:23:03.637 INFO:teuthology.orchestra.run.trial086.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2026-02-18T03:23:03.642 INFO:teuthology.orchestra.run.trial086.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2026-02-18T03:23:03.664 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:23:03.666 INFO:teuthology.orchestra.run.trial155.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:03.769 INFO:teuthology.orchestra.run.trial086.stdout:(36/37): librados2-20.2.0-670.gadc19233.el9.x86 24 MB/s | 3.5 MB 00:00 2026-02-18T03:23:03.787 INFO:teuthology.orchestra.run.trial086.stdout:(37/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 19 MB/s | 2.8 MB 00:00 2026-02-18T03:23:03.791 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:03.791 INFO:teuthology.orchestra.run.trial086.stdout:Total 24 MB/s | 79 MB 00:03 2026-02-18T03:23:03.852 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:03.856 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.891 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:03.901 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:03.901 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:23:03.901 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:23:03.902 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:03.904 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:03.909 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:03.909 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:03.943 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:03.943 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:23:03.943 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:03.984 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:23:03.986 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:23:04.207 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:04.207 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:04.546 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:04.557 INFO:teuthology.orchestra.run.trial086.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T03:23:04.713 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T03:23:04.716 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:04.778 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:04.782 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:04.782 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:04.808 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:04.811 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:04.818 INFO:teuthology.orchestra.run.trial086.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T03:23:04.821 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T03:23:04.823 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T03:23:04.828 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T03:23:04.837 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T03:23:04.848 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:04.849 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:04.861 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:04.891 INFO:teuthology.orchestra.run.trial086.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T03:23:04.895 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T03:23:04.901 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T03:23:04.903 INFO:teuthology.orchestra.run.trial086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T03:23:04.908 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T03:23:05.032 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:05.033 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:05.060 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T03:23:05.062 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T03:23:05.068 INFO:teuthology.orchestra.run.trial086.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T03:23:05.085 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:05.088 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:05.349 INFO:teuthology.orchestra.run.trial086.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T03:23:05.350 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:05.367 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T03:23:05.370 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T03:23:05.375 INFO:teuthology.orchestra.run.trial086.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T03:23:05.377 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T03:23:05.378 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:05.388 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:05.392 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:05.396 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T03:23:05.433 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:05.433 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:23:05.434 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:23:05.434 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:05.438 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:05.512 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T03:23:05.514 INFO:teuthology.orchestra.run.trial086.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:05.802 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T03:23:05.802 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T03:23:05.802 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:05.845 INFO:teuthology.orchestra.run.trial086.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T03:23:05.847 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T03:23:06.925 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:06.927 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:07.223 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T03:23:07.226 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:07.266 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T03:23:07.266 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T03:23:07.266 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T03:23:07.266 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:07.270 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:07.706 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:07.706 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /sys 2026-02-18T03:23:07.706 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /proc 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /mnt 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /var/tmp 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /home 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /root 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /tmp 2026-02-18T03:23:07.707 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /sys 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /proc 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /mnt 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /var/tmp 2026-02-18T03:23:07.841 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /home 2026-02-18T03:23:07.842 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /root 2026-02-18T03:23:07.842 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /tmp 2026-02-18T03:23:07.842 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /sys 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /proc 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /mnt 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /var/tmp 2026-02-18T03:23:08.477 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /home 2026-02-18T03:23:08.478 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /root 2026-02-18T03:23:08.478 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /tmp 2026-02-18T03:23:08.478 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:08.732 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:08.757 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:08.758 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:08.758 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:23:08.758 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:08.758 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:08.758 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:08.760 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:08.773 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:08.773 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:08.828 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:08.829 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:23:08.829 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:08.865 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:08.888 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:08.888 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:08.888 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:23:08.888 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:08.888 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:08.889 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:08.890 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:08.903 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:08.903 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:08.957 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:23:08.957 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:09.158 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:23:09.159 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:23:09.160 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:23:09.160 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:23:09.160 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:09.160 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:23:09.160 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:23:09.216 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout:Upgraded: 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:23:09.217 INFO:teuthology.orchestra.run.trial034.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:23:09.218 INFO:teuthology.orchestra.run.trial034.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:23:09.218 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:09.218 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:09.260 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-test 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:23:09.270 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:23:09.271 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:23:09.328 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:09.328 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout:Upgraded: 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:09.329 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:09.370 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-test 2026-02-18T03:23:09.506 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:09.530 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:09.532 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:09.546 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:09.546 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:09.569 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:15 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:09.603 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:09.603 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:23:09.603 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:09.650 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:09.650 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Install 5 Packages 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 85 M 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 364 M 2026-02-18T03:23:09.651 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:09.675 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:20 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:09.756 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repository Size 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Install 5 Packages 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 85 M 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 364 M 2026-02-18T03:23:09.757 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:09.793 INFO:teuthology.orchestra.run.trial034.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.1 MB/s | 233 kB 00:00 2026-02-18T03:23:09.821 INFO:teuthology.orchestra.run.trial034.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-18T03:23:09.823 INFO:teuthology.orchestra.run.trial034.stdout:(3/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 1.9 MB/s | 164 kB 00:00 2026-02-18T03:23:09.847 INFO:teuthology.orchestra.run.trial034.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:23:09.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:23:09.916 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-18T03:23:09.929 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:09.972 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:09.972 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:09.972 INFO:teuthology.orchestra.run.trial014.stdout:Upgraded: 2026-02-18T03:23:09.972 INFO:teuthology.orchestra.run.trial014.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:09.973 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:10.017 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-test 2026-02-18T03:23:10.080 INFO:teuthology.orchestra.run.trial177.stdout:(1/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 624 kB/s | 164 kB 00:00 2026-02-18T03:23:10.323 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:19 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:10.405 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Install 5 Packages 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 85 M 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 364 M 2026-02-18T03:23:10.406 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:10.544 INFO:teuthology.orchestra.run.trial014.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.4 MB/s | 233 kB 00:00 2026-02-18T03:23:10.561 INFO:teuthology.orchestra.run.trial014.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-18T03:23:10.570 INFO:teuthology.orchestra.run.trial014.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-18T03:23:10.647 INFO:teuthology.orchestra.run.trial177.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 281 kB/s | 233 kB 00:00 2026-02-18T03:23:10.735 INFO:teuthology.orchestra.run.trial177.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 463 kB/s | 303 kB 00:00 2026-02-18T03:23:10.744 INFO:teuthology.orchestra.run.trial177.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 647 kB/s | 64 kB 00:00 2026-02-18T03:23:10.867 INFO:teuthology.orchestra.run.trial014.stdout:(4/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 437 kB/s | 164 kB 00:00 2026-02-18T03:23:10.982 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:11.005 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:11.005 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:11.005 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:23:11.005 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:11.006 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:11.006 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.006 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:11.020 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:11.020 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:11.074 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:11.075 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:23:11.075 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.386 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:23:11.387 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:23:11.445 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:23:11.446 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.447 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:23:11.448 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.449 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:23:11.450 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:23:11.451 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.451 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:11.489 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test 2026-02-18T03:23:11.548 INFO:teuthology.orchestra.run.trial034.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 46 MB/s | 84 MB 00:01 2026-02-18T03:23:11.550 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:11.550 INFO:teuthology.orchestra.run.trial034.stdout:Total 45 MB/s | 85 MB 00:01 2026-02-18T03:23:11.578 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:11.589 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:11.589 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:11.760 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /sys 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /proc 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /mnt 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /var/tmp 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /home 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /root 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /tmp 2026-02-18T03:23:11.761 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:11.802 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:17 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:11.874 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:11.874 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:11.884 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:11.885 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:11.885 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:11.886 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:11.887 INFO:teuthology.orchestra.run.trial155.stdout:Install 5 Packages 2026-02-18T03:23:11.887 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:11.887 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 85 M 2026-02-18T03:23:11.887 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 364 M 2026-02-18T03:23:11.887 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:12.026 INFO:teuthology.orchestra.run.trial155.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.6 MB/s | 233 kB 00:00 2026-02-18T03:23:12.044 INFO:teuthology.orchestra.run.trial155.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-18T03:23:12.053 INFO:teuthology.orchestra.run.trial155.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-18T03:23:12.181 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:12.187 INFO:teuthology.orchestra.run.trial034.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:23:12.191 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:23:12.198 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:23:12.199 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:12.301 INFO:teuthology.orchestra.run.trial155.stdout:(4/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 505 kB/s | 164 kB 00:00 2026-02-18T03:23:12.788 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:12.812 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T03:23:12.813 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:12.813 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T03:23:12.813 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:12.813 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T03:23:12.813 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:12.814 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:12.827 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T03:23:12.827 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:12.882 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:12.882 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'qat' with GID 992. 2026-02-18T03:23:12.882 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T03:23:13.200 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T03:23:13.201 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T03:23:13.257 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T03:23:13.257 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:13.257 INFO:teuthology.orchestra.run.trial086.stdout:Upgraded: 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:13.258 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:13.300 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-18T03:23:13.611 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:14 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:13.692 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T03:23:13.693 INFO:teuthology.orchestra.run.trial086.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:Install 5 Packages 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 85 M 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 364 M 2026-02-18T03:23:13.694 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:13.780 INFO:teuthology.orchestra.run.trial086.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 8.9 MB/s | 233 kB 00:00 2026-02-18T03:23:13.792 INFO:teuthology.orchestra.run.trial086.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 25 MB/s | 303 kB 00:00 2026-02-18T03:23:13.797 INFO:teuthology.orchestra.run.trial086.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 14 MB/s | 64 kB 00:00 2026-02-18T03:23:14.063 INFO:teuthology.orchestra.run.trial177.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 20 MB/s | 84 MB 00:04 2026-02-18T03:23:14.065 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:14.066 INFO:teuthology.orchestra.run.trial177.stdout:Total 20 MB/s | 85 MB 00:04 2026-02-18T03:23:14.072 INFO:teuthology.orchestra.run.trial086.stdout:(4/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 518 kB/s | 164 kB 00:00 2026-02-18T03:23:14.091 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:14.101 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:14.102 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:14.391 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:14.392 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:14.705 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:14.710 INFO:teuthology.orchestra.run.trial177.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:23:14.714 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:23:14.722 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:23:14.723 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:14.955 INFO:teuthology.orchestra.run.trial014.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 19 MB/s | 84 MB 00:04 2026-02-18T03:23:14.956 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:14.956 INFO:teuthology.orchestra.run.trial014.stdout:Total 19 MB/s | 85 MB 00:04 2026-02-18T03:23:14.984 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:14.995 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:14.995 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:15.284 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:15.285 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:15.594 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:15.600 INFO:teuthology.orchestra.run.trial014.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:23:15.604 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:23:15.612 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:23:15.612 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:15.910 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:15.927 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:16.270 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:16.270 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:23:16.271 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:23:16.271 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:23:16.271 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:23:16.322 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:23:16.322 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:16.322 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:16.322 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:16.322 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:16.323 INFO:teuthology.orchestra.run.trial034.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:23:16.323 INFO:teuthology.orchestra.run.trial034.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:23:16.323 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:23:16.323 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:16.323 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:16.357 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph 2026-02-18T03:23:16.657 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:22 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:16.741 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:16.744 INFO:teuthology.orchestra.run.trial034.stdout:====================================================================================== 2026-02-18T03:23:16.744 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-18T03:23:16.744 INFO:teuthology.orchestra.run.trial034.stdout:====================================================================================== 2026-02-18T03:23:16.744 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:16.744 INFO:teuthology.orchestra.run.trial034.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:23:16.745 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:23:16.746 INFO:teuthology.orchestra.run.trial034.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:23:16.747 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:23:16.748 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:23:16.749 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:23:16.750 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:23:16.751 INFO:teuthology.orchestra.run.trial034.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:16.752 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:16.753 INFO:teuthology.orchestra.run.trial034.stdout:====================================================================================== 2026-02-18T03:23:16.753 INFO:teuthology.orchestra.run.trial034.stdout:Install 95 Packages 2026-02-18T03:23:16.753 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:16.753 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 101 M 2026-02-18T03:23:16.754 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 561 M 2026-02-18T03:23:16.754 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:17.141 INFO:teuthology.orchestra.run.trial086.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 25 MB/s | 84 MB 00:03 2026-02-18T03:23:17.143 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:17.143 INFO:teuthology.orchestra.run.trial086.stdout:Total 25 MB/s | 85 MB 00:03 2026-02-18T03:23:17.163 INFO:teuthology.orchestra.run.trial034.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 63 kB/s | 6.5 kB 00:00 2026-02-18T03:23:17.166 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:17.176 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:17.176 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:17.335 INFO:teuthology.orchestra.run.trial034.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 3.4 MB/s | 961 kB 00:00 2026-02-18T03:23:17.463 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:17.464 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:17.509 INFO:teuthology.orchestra.run.trial034.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 5.2 MB/s | 2.3 MB 00:00 2026-02-18T03:23:17.542 INFO:teuthology.orchestra.run.trial034.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 1.3 MB/s | 43 kB 00:00 2026-02-18T03:23:17.564 INFO:teuthology.orchestra.run.trial034.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 7.8 MB/s | 173 kB 00:00 2026-02-18T03:23:17.648 INFO:teuthology.orchestra.run.trial155.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 15 MB/s | 84 MB 00:05 2026-02-18T03:23:17.650 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:17.650 INFO:teuthology.orchestra.run.trial155.stdout:Total 15 MB/s | 85 MB 00:05 2026-02-18T03:23:17.677 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:17.686 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:17.686 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:17.775 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:17.781 INFO:teuthology.orchestra.run.trial086.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:23:17.785 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:23:17.793 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:23:17.793 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:17.859 INFO:teuthology.orchestra.run.trial034.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 7.3 MB/s | 5.1 MB 00:00 2026-02-18T03:23:17.973 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:17.973 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:18.093 INFO:teuthology.orchestra.run.trial034.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 20 MB/s | 11 MB 00:00 2026-02-18T03:23:18.111 INFO:teuthology.orchestra.run.trial034.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.2 MB/s | 22 kB 00:00 2026-02-18T03:23:18.145 INFO:teuthology.orchestra.run.trial034.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 8.4 MB/s | 290 kB 00:00 2026-02-18T03:23:18.176 INFO:teuthology.orchestra.run.trial034.stdout:(10/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 20 MB/s | 17 MB 00:00 2026-02-18T03:23:18.177 INFO:teuthology.orchestra.run.trial034.stdout:(11/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 1.5 MB/s | 50 kB 00:00 2026-02-18T03:23:18.189 INFO:teuthology.orchestra.run.trial034.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.4 MB/s | 17 kB 00:00 2026-02-18T03:23:18.193 INFO:teuthology.orchestra.run.trial034.stdout:(13/95): ceph-volume-20.2.0-670.gadc19233.el9.n 18 MB/s | 297 kB 00:00 2026-02-18T03:23:18.223 INFO:teuthology.orchestra.run.trial034.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 29 MB/s | 1.0 MB 00:00 2026-02-18T03:23:18.258 INFO:teuthology.orchestra.run.trial034.stdout:(15/95): ceph-mgr-diskprediction-local-20.2.0-6 19 MB/s | 7.4 MB 00:00 2026-02-18T03:23:18.259 INFO:teuthology.orchestra.run.trial034.stdout:(16/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.2 MB/s | 350 kB 00:00 2026-02-18T03:23:18.259 INFO:teuthology.orchestra.run.trial034.stdout:(17/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.1 MB/s | 40 kB 00:00 2026-02-18T03:23:18.281 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:18.283 INFO:teuthology.orchestra.run.trial034.stdout:(18/95): libconfig-1.7.2-9.el9.x86_64.rpm 2.9 MB/s | 72 kB 00:00 2026-02-18T03:23:18.287 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T03:23:18.291 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T03:23:18.292 INFO:teuthology.orchestra.run.trial034.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 5.5 MB/s | 184 kB 00:00 2026-02-18T03:23:18.294 INFO:teuthology.orchestra.run.trial034.stdout:(20/95): libgfortran-11.5.0-14.el9.x86_64.rpm 23 MB/s | 794 kB 00:00 2026-02-18T03:23:18.299 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T03:23:18.299 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:18.308 INFO:teuthology.orchestra.run.trial034.stdout:(21/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-18T03:23:18.318 INFO:teuthology.orchestra.run.trial034.stdout:(22/95): python3-cryptography-36.0.1-5.el9.x86_ 49 MB/s | 1.2 MB 00:00 2026-02-18T03:23:18.319 INFO:teuthology.orchestra.run.trial034.stdout:(23/95): python3-ply-3.11-14.el9.noarch.rpm 4.1 MB/s | 106 kB 00:00 2026-02-18T03:23:18.331 INFO:teuthology.orchestra.run.trial034.stdout:(24/95): python3-pycparser-2.20-6.el9.noarch.rp 5.8 MB/s | 135 kB 00:00 2026-02-18T03:23:18.339 INFO:teuthology.orchestra.run.trial034.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 6.2 MB/s | 126 kB 00:00 2026-02-18T03:23:18.344 INFO:teuthology.orchestra.run.trial034.stdout:(26/95): python3-pyparsing-2.4.7-9.el9.noarch.r 5.8 MB/s | 150 kB 00:00 2026-02-18T03:23:18.356 INFO:teuthology.orchestra.run.trial034.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 8.5 MB/s | 218 kB 00:00 2026-02-18T03:23:18.365 INFO:teuthology.orchestra.run.trial034.stdout:(28/95): unzip-6.0-59.el9.x86_64.rpm 7.0 MB/s | 182 kB 00:00 2026-02-18T03:23:18.377 INFO:teuthology.orchestra.run.trial034.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 7.9 MB/s | 266 kB 00:00 2026-02-18T03:23:18.404 INFO:teuthology.orchestra.run.trial034.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 623 kB/s | 30 kB 00:00 2026-02-18T03:23:18.419 INFO:teuthology.orchestra.run.trial034.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 356 kB/s | 15 kB 00:00 2026-02-18T03:23:18.447 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:18.465 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:18.468 INFO:teuthology.orchestra.run.trial034.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.7 MB/s | 246 kB 00:00 2026-02-18T03:23:18.482 INFO:teuthology.orchestra.run.trial034.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 188 kB 00:00 2026-02-18T03:23:18.490 INFO:teuthology.orchestra.run.trial034.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-18T03:23:18.536 INFO:teuthology.orchestra.run.trial034.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 18 MB/s | 3.0 MB 00:00 2026-02-18T03:23:18.552 INFO:teuthology.orchestra.run.trial034.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 16 MB/s | 1.0 MB 00:00 2026-02-18T03:23:18.576 INFO:teuthology.orchestra.run.trial034.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-18T03:23:18.594 INFO:teuthology.orchestra.run.trial034.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 102 MB/s | 6.0 MB 00:00 2026-02-18T03:23:18.603 INFO:teuthology.orchestra.run.trial034.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.1 MB/s | 249 kB 00:00 2026-02-18T03:23:18.617 INFO:teuthology.orchestra.run.trial034.stdout:(40/95): python3-jmespath-1.0.1-1.el9.noarch.rp 2.1 MB/s | 48 kB 00:00 2026-02-18T03:23:18.627 INFO:teuthology.orchestra.run.trial034.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-18T03:23:18.644 INFO:teuthology.orchestra.run.trial034.stdout:(42/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 46 MB/s | 1.2 MB 00:00 2026-02-18T03:23:18.649 INFO:teuthology.orchestra.run.trial034.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-18T03:23:18.673 INFO:teuthology.orchestra.run.trial034.stdout:(44/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 28 MB/s | 5.3 MB 00:00 2026-02-18T03:23:18.675 INFO:teuthology.orchestra.run.trial034.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-18T03:23:18.696 INFO:teuthology.orchestra.run.trial034.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-18T03:23:18.699 INFO:teuthology.orchestra.run.trial034.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-18T03:23:18.718 INFO:teuthology.orchestra.run.trial034.stdout:(48/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 82 MB/s | 6.1 MB 00:00 2026-02-18T03:23:18.720 INFO:teuthology.orchestra.run.trial034.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.5 MB/s | 159 kB 00:00 2026-02-18T03:23:18.724 INFO:teuthology.orchestra.run.trial034.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-18T03:23:18.741 INFO:teuthology.orchestra.run.trial034.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-18T03:23:18.747 INFO:teuthology.orchestra.run.trial034.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-18T03:23:18.764 INFO:teuthology.orchestra.run.trial034.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.1 MB/s | 189 kB 00:00 2026-02-18T03:23:18.769 INFO:teuthology.orchestra.run.trial034.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-18T03:23:18.781 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:18.781 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:23:18.781 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:23:18.781 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:23:18.781 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:23:18.834 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:23:18.834 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:18.834 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:18.834 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:18.834 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:18.835 INFO:teuthology.orchestra.run.trial177.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:23:18.835 INFO:teuthology.orchestra.run.trial177.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:23:18.835 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:23:18.835 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:18.835 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:18.872 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph 2026-02-18T03:23:19.154 INFO:teuthology.orchestra.run.trial034.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 44 MB/s | 19 MB 00:00 2026-02-18T03:23:19.184 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:30 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:19.200 INFO:teuthology.orchestra.run.trial034.stdout:(56/95): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-18T03:23:19.269 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:19.272 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-18T03:23:19.272 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repository Size 2026-02-18T03:23:19.272 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:23:19.273 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:23:19.274 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:23:19.275 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:23:19.276 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:23:19.277 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:23:19.278 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:23:19.279 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout:Installing weak dependencies: 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:23:19.280 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:19.281 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:19.281 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-18T03:23:19.281 INFO:teuthology.orchestra.run.trial177.stdout:Install 95 Packages 2026-02-18T03:23:19.281 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:19.281 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 101 M 2026-02-18T03:23:19.282 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 561 M 2026-02-18T03:23:19.282 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:19.405 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:19.422 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:19.442 INFO:teuthology.orchestra.run.trial034.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2026-02-18T03:23:19.624 INFO:teuthology.orchestra.run.trial034.stdout:(58/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-18T03:23:19.648 INFO:teuthology.orchestra.run.trial034.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 734 kB/s | 151 kB 00:00 2026-02-18T03:23:19.674 INFO:teuthology.orchestra.run.trial034.stdout:(60/95): protobuf-compiler-3.14.0-17.el9.x86_64 953 kB/s | 862 kB 00:00 2026-02-18T03:23:19.714 INFO:teuthology.orchestra.run.trial034.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 447 kB/s | 29 kB 00:00 2026-02-18T03:23:19.718 INFO:teuthology.orchestra.run.trial034.stdout:(62/95): python3-asyncssh-2.13.2-5.el9.noarch.r 5.7 MB/s | 548 kB 00:00 2026-02-18T03:23:19.771 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:19.771 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:23:19.771 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:23:19.771 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:23:19.771 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:23:19.775 INFO:teuthology.orchestra.run.trial034.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 565 kB/s | 32 kB 00:00 2026-02-18T03:23:19.783 INFO:teuthology.orchestra.run.trial034.stdout:(64/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 630 kB/s | 43 kB 00:00 2026-02-18T03:23:19.822 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:23:19.822 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:19.822 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:19.822 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:19.823 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:19.831 INFO:teuthology.orchestra.run.trial034.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 253 kB/s | 14 kB 00:00 2026-02-18T03:23:19.860 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph 2026-02-18T03:23:19.884 INFO:teuthology.orchestra.run.trial034.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 1.7 MB/s | 173 kB 00:00 2026-02-18T03:23:19.907 INFO:teuthology.orchestra.run.trial034.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 4.6 MB/s | 358 kB 00:00 2026-02-18T03:23:19.966 INFO:teuthology.orchestra.run.trial034.stdout:(68/95): python3-backports-tarfile-1.2.0-1.el9. 206 kB/s | 60 kB 00:00 2026-02-18T03:23:19.994 INFO:teuthology.orchestra.run.trial034.stdout:(69/95): python3-google-auth-2.45.0-1.el9.noarc 2.3 MB/s | 254 kB 00:00 2026-02-18T03:23:20.073 INFO:teuthology.orchestra.run.trial034.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 1.7 MB/s | 139 kB 00:00 2026-02-18T03:23:20.076 INFO:teuthology.orchestra.run.trial034.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2026-02-18T03:23:20.110 INFO:teuthology.orchestra.run.trial034.stdout:(72/95): python3-grpcio-tools-1.46.7-10.el9.x86 1.0 MB/s | 144 kB 00:00 2026-02-18T03:23:20.113 INFO:teuthology.orchestra.run.trial177.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 117 kB/s | 6.5 kB 00:00 2026-02-18T03:23:20.132 INFO:teuthology.orchestra.run.trial034.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 192 kB/s | 11 kB 00:00 2026-02-18T03:23:20.139 INFO:teuthology.orchestra.run.trial034.stdout:(74/95): python3-isodate-0.6.1-3.el9.noarch.rpm 847 kB/s | 56 kB 00:00 2026-02-18T03:23:20.169 INFO:teuthology.orchestra.run.trial034.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 299 kB/s | 18 kB 00:00 2026-02-18T03:23:20.173 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:20.188 INFO:teuthology.orchestra.run.trial034.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 413 kB/s | 23 kB 00:00 2026-02-18T03:23:20.189 INFO:teuthology.orchestra.run.trial177.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 7.1 MB/s | 961 kB 00:00 2026-02-18T03:23:20.200 INFO:teuthology.orchestra.run.trial034.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 322 kB/s | 20 kB 00:00 2026-02-18T03:23:20.207 INFO:teuthology.orchestra.run.trial177.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 16 MB/s | 2.3 MB 00:00 2026-02-18T03:23:20.229 INFO:teuthology.orchestra.run.trial034.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 328 kB/s | 19 kB 00:00 2026-02-18T03:23:20.235 INFO:teuthology.orchestra.run.trial177.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 1.5 MB/s | 43 kB 00:00 2026-02-18T03:23:20.244 INFO:teuthology.orchestra.run.trial034.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 471 kB/s | 26 kB 00:00 2026-02-18T03:23:20.259 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:23:20.262 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:23:20.263 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Installing weak dependencies: 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Install 95 Packages 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 101 M 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 561 M 2026-02-18T03:23:20.264 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:20.270 INFO:teuthology.orchestra.run.trial177.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 4.8 MB/s | 173 kB 00:00 2026-02-18T03:23:20.301 INFO:teuthology.orchestra.run.trial034.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.5 MB/s | 86 kB 00:00 2026-02-18T03:23:20.302 INFO:teuthology.orchestra.run.trial034.stdout:(81/95): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2026-02-18T03:23:20.357 INFO:teuthology.orchestra.run.trial034.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.0 MB/s | 58 kB 00:00 2026-02-18T03:23:20.360 INFO:teuthology.orchestra.run.trial034.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2026-02-18T03:23:20.387 INFO:teuthology.orchestra.run.trial034.stdout:(84/95): python3-kubernetes-26.1.0-3.el9.noarch 5.5 MB/s | 1.0 MB 00:00 2026-02-18T03:23:20.414 INFO:teuthology.orchestra.run.trial034.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2026-02-18T03:23:20.422 INFO:teuthology.orchestra.run.trial034.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 497 kB/s | 31 kB 00:00 2026-02-18T03:23:20.452 INFO:teuthology.orchestra.run.trial034.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2026-02-18T03:23:20.471 INFO:teuthology.orchestra.run.trial034.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2026-02-18T03:23:20.506 INFO:teuthology.orchestra.run.trial034.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-18T03:23:20.511 INFO:teuthology.orchestra.run.trial034.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 604 kB/s | 36 kB 00:00 2026-02-18T03:23:20.522 INFO:teuthology.orchestra.run.trial177.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 12 MB/s | 5.1 MB 00:00 2026-02-18T03:23:20.528 INFO:teuthology.orchestra.run.trial034.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 1.5 MB/s | 86 kB 00:00 2026-02-18T03:23:20.571 INFO:teuthology.orchestra.run.trial034.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 804 kB/s | 48 kB 00:00 2026-02-18T03:23:20.583 INFO:teuthology.orchestra.run.trial034.stdout:(93/95): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2026-02-18T03:23:20.584 INFO:teuthology.orchestra.run.trial034.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 393 kB/s | 22 kB 00:00 2026-02-18T03:23:20.631 INFO:teuthology.orchestra.run.trial034.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 333 kB/s | 20 kB 00:00 2026-02-18T03:23:20.637 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:20.637 INFO:teuthology.orchestra.run.trial034.stdout:Total 26 MB/s | 101 MB 00:03 2026-02-18T03:23:20.758 INFO:teuthology.orchestra.run.trial177.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 22 MB/s | 11 MB 00:00 2026-02-18T03:23:20.785 INFO:teuthology.orchestra.run.trial177.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 806 kB/s | 22 kB 00:00 2026-02-18T03:23:20.806 INFO:teuthology.orchestra.run.trial014.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 35 kB/s | 6.5 kB 00:00 2026-02-18T03:23:20.823 INFO:teuthology.orchestra.run.trial177.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 7.6 MB/s | 290 kB 00:00 2026-02-18T03:23:20.856 INFO:teuthology.orchestra.run.trial177.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 1.5 MB/s | 50 kB 00:00 2026-02-18T03:23:20.893 INFO:teuthology.orchestra.run.trial177.stdout:(11/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 24 MB/s | 17 MB 00:00 2026-02-18T03:23:20.893 INFO:teuthology.orchestra.run.trial177.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 468 kB/s | 17 kB 00:00 2026-02-18T03:23:20.911 INFO:teuthology.orchestra.run.trial177.stdout:(13/95): ceph-volume-20.2.0-670.gadc19233.el9.n 16 MB/s | 297 kB 00:00 2026-02-18T03:23:20.929 INFO:teuthology.orchestra.run.trial177.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 28 MB/s | 1.0 MB 00:00 2026-02-18T03:23:20.981 INFO:teuthology.orchestra.run.trial177.stdout:(15/95): ceph-mgr-diskprediction-local-20.2.0-6 16 MB/s | 7.4 MB 00:00 2026-02-18T03:23:21.041 INFO:teuthology.orchestra.run.trial014.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 2.2 MB/s | 961 kB 00:00 2026-02-18T03:23:21.066 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:21.102 INFO:teuthology.orchestra.run.trial014.stdout:(3/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 17 MB/s | 5.1 MB 00:00 2026-02-18T03:23:21.104 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:21.104 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:21.113 INFO:teuthology.orchestra.run.trial014.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 3.7 MB/s | 43 kB 00:00 2026-02-18T03:23:21.125 INFO:teuthology.orchestra.run.trial014.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 14 MB/s | 173 kB 00:00 2026-02-18T03:23:21.188 INFO:teuthology.orchestra.run.trial014.stdout:(6/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 4.1 MB/s | 2.3 MB 00:00 2026-02-18T03:23:21.367 INFO:teuthology.orchestra.run.trial177.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 92 kB/s | 40 kB 00:00 2026-02-18T03:23:21.436 INFO:teuthology.orchestra.run.trial014.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 34 MB/s | 11 MB 00:00 2026-02-18T03:23:21.447 INFO:teuthology.orchestra.run.trial014.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.9 MB/s | 22 kB 00:00 2026-02-18T03:23:21.465 INFO:teuthology.orchestra.run.trial014.stdout:(9/95): ceph-mgr-modules-core-20.2.0-670.gadc19 16 MB/s | 290 kB 00:00 2026-02-18T03:23:21.478 INFO:teuthology.orchestra.run.trial014.stdout:(10/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 3.8 MB/s | 50 kB 00:00 2026-02-18T03:23:21.478 INFO:teuthology.orchestra.run.trial177.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 145 kB/s | 72 kB 00:00 2026-02-18T03:23:21.490 INFO:teuthology.orchestra.run.trial014.stdout:(11/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.4 MB/s | 17 kB 00:00 2026-02-18T03:23:21.509 INFO:teuthology.orchestra.run.trial014.stdout:(12/95): ceph-volume-20.2.0-670.gadc19233.el9.n 15 MB/s | 297 kB 00:00 2026-02-18T03:23:21.510 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:21.528 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:21.533 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:21.533 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:21.555 INFO:teuthology.orchestra.run.trial014.stdout:(13/95): cephadm-20.2.0-670.gadc19233.el9.noarc 22 MB/s | 1.0 MB 00:00 2026-02-18T03:23:21.587 INFO:teuthology.orchestra.run.trial177.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 518 kB/s | 350 kB 00:00 2026-02-18T03:23:21.656 INFO:teuthology.orchestra.run.trial177.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 184 kB 00:00 2026-02-18T03:23:21.668 INFO:teuthology.orchestra.run.trial014.stdout:(14/95): ceph-mgr-diskprediction-local-20.2.0-6 15 MB/s | 7.4 MB 00:00 2026-02-18T03:23:21.687 INFO:teuthology.orchestra.run.trial177.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2026-02-18T03:23:21.787 INFO:teuthology.orchestra.run.trial177.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2026-02-18T03:23:21.809 INFO:teuthology.orchestra.run.trial014.stdout:(15/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 22 MB/s | 17 MB 00:00 2026-02-18T03:23:21.861 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:21.861 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:23:21.861 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:23:21.861 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:23:21.861 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:23:21.887 INFO:teuthology.orchestra.run.trial177.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 135 kB 00:00 2026-02-18T03:23:21.915 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:23:21.915 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:21.915 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:21.915 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:21.915 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:21.916 INFO:teuthology.orchestra.run.trial086.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:23:21.916 INFO:teuthology.orchestra.run.trial086.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:23:21.916 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:23:21.916 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:21.916 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:21.954 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-18T03:23:21.984 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:21.986 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:23:21.987 INFO:teuthology.orchestra.run.trial177.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 1.5 MB/s | 150 kB 00:00 2026-02-18T03:23:21.990 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:23:21.992 INFO:teuthology.orchestra.run.trial177.stdout:(24/95): python3-cryptography-36.0.1-5.el9.x86_ 3.7 MB/s | 1.2 MB 00:00 2026-02-18T03:23:22.011 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:23:22.044 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:23:22.053 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:23:22.059 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:23:22.061 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:23:22.065 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:23:22.069 INFO:teuthology.orchestra.run.trial014.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 101 kB/s | 40 kB 00:00 2026-02-18T03:23:22.087 INFO:teuthology.orchestra.run.trial177.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 1.2 MB/s | 126 kB 00:00 2026-02-18T03:23:22.088 INFO:teuthology.orchestra.run.trial034.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:23:22.092 INFO:teuthology.orchestra.run.trial177.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 2.1 MB/s | 218 kB 00:00 2026-02-18T03:23:22.101 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:23:22.104 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:23:22.110 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:23:22.112 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:23:22.123 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:23:22.129 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:23:22.152 INFO:teuthology.orchestra.run.trial034.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:23:22.156 INFO:teuthology.orchestra.run.trial034.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:23:22.162 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:23:22.187 INFO:teuthology.orchestra.run.trial177.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 1.8 MB/s | 182 kB 00:00 2026-02-18T03:23:22.192 INFO:teuthology.orchestra.run.trial177.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 2.6 MB/s | 266 kB 00:00 2026-02-18T03:23:22.213 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:23:22.225 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:23:22.226 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T03:23:22.228 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:23:22.232 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:23:22.233 INFO:teuthology.orchestra.run.trial177.stdout:(29/95): flexiblas-3.0.4-9.el9.x86_64.rpm 642 kB/s | 30 kB 00:00 2026-02-18T03:23:22.237 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:23:22.239 INFO:teuthology.orchestra.run.trial177.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 2.4 MB/s | 15 kB 00:00 2026-02-18T03:23:22.242 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:23:22.243 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:22.245 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:23:22.254 INFO:teuthology.orchestra.run.trial177.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 17 MB/s | 246 kB 00:00 2026-02-18T03:23:22.259 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:23:22.262 INFO:teuthology.orchestra.run.trial177.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 23 MB/s | 188 kB 00:00 2026-02-18T03:23:22.264 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:23:22.265 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:23 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:22.269 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:23:22.269 INFO:teuthology.orchestra.run.trial177.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 6.6 MB/s | 42 kB 00:00 2026-02-18T03:23:22.280 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:23:22.287 INFO:teuthology.orchestra.run.trial014.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 151 kB/s | 72 kB 00:00 2026-02-18T03:23:22.289 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:23:22.295 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:23:22.299 INFO:teuthology.orchestra.run.trial177.stdout:(34/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 28 MB/s | 3.0 MB 00:00 2026-02-18T03:23:22.312 INFO:teuthology.orchestra.run.trial177.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 83 MB/s | 1.0 MB 00:00 2026-02-18T03:23:22.314 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:23:22.325 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:23:22.341 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:23:22.345 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:23:22.347 INFO:teuthology.orchestra.run.trial177.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 171 MB/s | 6.0 MB 00:00 2026-02-18T03:23:22.350 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:23:22.353 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:23:22.354 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:23:22.355 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout:Install 95 Packages 2026-02-18T03:23:22.356 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:22.357 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:23:22.357 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 101 M 2026-02-18T03:23:22.357 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 561 M 2026-02-18T03:23:22.357 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:22.360 INFO:teuthology.orchestra.run.trial177.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-18T03:23:22.368 INFO:teuthology.orchestra.run.trial177.stdout:(38/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 34 MB/s | 249 kB 00:00 2026-02-18T03:23:22.375 INFO:teuthology.orchestra.run.trial177.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 6.5 MB/s | 48 kB 00:00 2026-02-18T03:23:22.382 INFO:teuthology.orchestra.run.trial177.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 23 MB/s | 177 kB 00:00 2026-02-18T03:23:22.393 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:23:22.417 INFO:teuthology.orchestra.run.trial177.stdout:(41/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 35 MB/s | 1.2 MB 00:00 2026-02-18T03:23:22.432 INFO:teuthology.orchestra.run.trial177.stdout:(42/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 32 MB/s | 5.3 MB 00:00 2026-02-18T03:23:22.432 INFO:teuthology.orchestra.run.trial177.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 2.3 MB/s | 35 kB 00:00 2026-02-18T03:23:22.448 INFO:teuthology.orchestra.run.trial177.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 27 MB/s | 442 kB 00:00 2026-02-18T03:23:22.456 INFO:teuthology.orchestra.run.trial177.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 9.8 MB/s | 77 kB 00:00 2026-02-18T03:23:22.467 INFO:teuthology.orchestra.run.trial177.stdout:(46/95): python3-protobuf-3.14.0-17.el9.noarch. 23 MB/s | 267 kB 00:00 2026-02-18T03:23:22.475 INFO:teuthology.orchestra.run.trial177.stdout:(47/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 21 MB/s | 159 kB 00:00 2026-02-18T03:23:22.486 INFO:teuthology.orchestra.run.trial177.stdout:(48/95): python3-pyasn1-modules-0.4.8-6.el9.noa 26 MB/s | 279 kB 00:00 2026-02-18T03:23:22.492 INFO:teuthology.orchestra.run.trial177.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 8.0 MB/s | 54 kB 00:00 2026-02-18T03:23:22.505 INFO:teuthology.orchestra.run.trial014.stdout:(18/95): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-18T03:23:22.525 INFO:teuthology.orchestra.run.trial014.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 775 kB/s | 184 kB 00:00 2026-02-18T03:23:22.588 INFO:teuthology.orchestra.run.trial177.stdout:(50/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 39 MB/s | 6.1 MB 00:00 2026-02-18T03:23:22.590 INFO:teuthology.orchestra.run.trial014.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-18T03:23:22.595 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T03:23:22.595 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T03:23:22.595 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T03:23:22.595 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T03:23:22.595 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T03:23:22.599 INFO:teuthology.orchestra.run.trial177.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 4.2 MB/s | 42 kB 00:00 2026-02-18T03:23:22.606 INFO:teuthology.orchestra.run.trial177.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 26 MB/s | 189 kB 00:00 2026-02-18T03:23:22.613 INFO:teuthology.orchestra.run.trial177.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 13 MB/s | 90 kB 00:00 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T03:23:22.647 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T03:23:22.648 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:22.648 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:22.673 INFO:teuthology.orchestra.run.trial014.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-18T03:23:22.686 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph 2026-02-18T03:23:22.693 INFO:teuthology.orchestra.run.trial177.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 280 kB/s | 22 kB 00:00 2026-02-18T03:23:22.714 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:23:22.724 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:23:22.728 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:23:22.734 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:23:22.736 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:23:22.757 INFO:teuthology.orchestra.run.trial014.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 1.6 MB/s | 135 kB 00:00 2026-02-18T03:23:22.764 INFO:teuthology.orchestra.run.trial034.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:23:22.781 INFO:teuthology.orchestra.run.trial177.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 67 MB/s | 19 MB 00:00 2026-02-18T03:23:22.807 INFO:teuthology.orchestra.run.trial034.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:23:22.814 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:23:22.818 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:23:22.823 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:23:22.827 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:23:22.834 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:23:22.837 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:23:22.839 INFO:teuthology.orchestra.run.trial177.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 5.8 MB/s | 862 kB 00:00 2026-02-18T03:23:22.840 INFO:teuthology.orchestra.run.trial014.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 1.8 MB/s | 150 kB 00:00 2026-02-18T03:23:22.865 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:23:22.874 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:23:22.880 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:23:22.887 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:23:22.921 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:23:22.924 INFO:teuthology.orchestra.run.trial014.stdout:(24/95): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-18T03:23:22.927 INFO:teuthology.orchestra.run.trial086.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 131 kB/s | 6.5 kB 00:00 2026-02-18T03:23:22.975 INFO:teuthology.orchestra.run.trial014.stdout:(25/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 247 kB/s | 350 kB 00:01 2026-02-18T03:23:22.991 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:23.009 INFO:teuthology.orchestra.run.trial014.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 2.5 MB/s | 218 kB 00:00 2026-02-18T03:23:23.015 INFO:teuthology.orchestra.run.trial086.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 6.8 MB/s | 961 kB 00:00 2026-02-18T03:23:23.042 INFO:teuthology.orchestra.run.trial086.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 14 MB/s | 2.3 MB 00:00 2026-02-18T03:23:23.075 INFO:teuthology.orchestra.run.trial086.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 1.3 MB/s | 43 kB 00:00 2026-02-18T03:23:23.079 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:23.081 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T03:23:23.082 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T03:23:23.083 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T03:23:23.084 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T03:23:23.085 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T03:23:23.086 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T03:23:23.087 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T03:23:23.088 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T03:23:23.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout:Install 95 Packages 2026-02-18T03:23:23.090 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:23.091 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 101 M 2026-02-18T03:23:23.092 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 561 M 2026-02-18T03:23:23.092 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:23.093 INFO:teuthology.orchestra.run.trial014.stdout:(27/95): zip-3.0-35.el9.x86_64.rpm 3.1 MB/s | 266 kB 00:00 2026-02-18T03:23:23.111 INFO:teuthology.orchestra.run.trial086.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 4.8 MB/s | 173 kB 00:00 2026-02-18T03:23:23.144 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:23:23.167 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:23:23.171 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:23:23.173 INFO:teuthology.orchestra.run.trial014.stdout:(28/95): flexiblas-3.0.4-9.el9.x86_64.rpm 367 kB/s | 30 kB 00:00 2026-02-18T03:23:23.198 INFO:teuthology.orchestra.run.trial086.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 19 MB/s | 5.1 MB 00:00 2026-02-18T03:23:23.228 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:23:23.230 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:23:23.236 INFO:teuthology.orchestra.run.trial177.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2026-02-18T03:23:23.251 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:23:23.362 INFO:teuthology.orchestra.run.trial014.stdout:(29/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-18T03:23:23.387 INFO:teuthology.orchestra.run.trial014.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 594 kB/s | 15 kB 00:00 2026-02-18T03:23:23.413 INFO:teuthology.orchestra.run.trial014.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 9.0 MB/s | 246 kB 00:00 2026-02-18T03:23:23.421 INFO:teuthology.orchestra.run.trial177.stdout:(58/95): libgfortran-11.5.0-14.el9.x86_64.rpm 387 kB/s | 794 kB 00:02 2026-02-18T03:23:23.440 INFO:teuthology.orchestra.run.trial014.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 6.9 MB/s | 188 kB 00:00 2026-02-18T03:23:23.445 INFO:teuthology.orchestra.run.trial014.stdout:(33/95): unzip-6.0-59.el9.x86_64.rpm 387 kB/s | 182 kB 00:00 2026-02-18T03:23:23.466 INFO:teuthology.orchestra.run.trial014.stdout:(34/95): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-18T03:23:23.467 INFO:teuthology.orchestra.run.trial014.stdout:(35/95): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-18T03:23:23.473 INFO:teuthology.orchestra.run.trial177.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 642 kB/s | 151 kB 00:00 2026-02-18T03:23:23.537 INFO:teuthology.orchestra.run.trial014.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 85 MB/s | 6.0 MB 00:00 2026-02-18T03:23:23.552 INFO:teuthology.orchestra.run.trial177.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 373 kB/s | 29 kB 00:00 2026-02-18T03:23:23.565 INFO:teuthology.orchestra.run.trial014.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 8.6 MB/s | 244 kB 00:00 2026-02-18T03:23:23.574 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:23:23.593 INFO:teuthology.orchestra.run.trial014.stdout:(38/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.8 MB/s | 249 kB 00:00 2026-02-18T03:23:23.616 INFO:teuthology.orchestra.run.trial086.stdout:(7/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 21 MB/s | 11 MB 00:00 2026-02-18T03:23:23.621 INFO:teuthology.orchestra.run.trial014.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 1.7 MB/s | 48 kB 00:00 2026-02-18T03:23:23.631 INFO:teuthology.orchestra.run.trial177.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 762 kB/s | 60 kB 00:00 2026-02-18T03:23:23.640 INFO:teuthology.orchestra.run.trial086.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 930 kB/s | 22 kB 00:00 2026-02-18T03:23:23.646 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:23:23.652 INFO:teuthology.orchestra.run.trial014.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 5.7 MB/s | 177 kB 00:00 2026-02-18T03:23:23.663 INFO:teuthology.orchestra.run.trial086.stdout:(9/95): ceph-mgr-diskprediction-local-20.2.0-67 16 MB/s | 7.4 MB 00:00 2026-02-18T03:23:23.666 INFO:teuthology.orchestra.run.trial086.stdout:(10/95): ceph-mgr-modules-core-20.2.0-670.gadc1 11 MB/s | 290 kB 00:00 2026-02-18T03:23:23.677 INFO:teuthology.orchestra.run.trial014.stdout:(41/95): protobuf-3.14.0-17.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2026-02-18T03:23:23.683 INFO:teuthology.orchestra.run.trial086.stdout:(11/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 2.5 MB/s | 50 kB 00:00 2026-02-18T03:23:23.685 INFO:teuthology.orchestra.run.trial086.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 914 kB/s | 17 kB 00:00 2026-02-18T03:23:23.703 INFO:teuthology.orchestra.run.trial014.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-18T03:23:23.706 INFO:teuthology.orchestra.run.trial086.stdout:(13/95): ceph-volume-20.2.0-670.gadc19233.el9.n 13 MB/s | 297 kB 00:00 2026-02-18T03:23:23.710 INFO:teuthology.orchestra.run.trial177.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 549 kB/s | 43 kB 00:00 2026-02-18T03:23:23.719 INFO:teuthology.orchestra.run.trial014.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2026-02-18T03:23:23.724 INFO:teuthology.orchestra.run.trial086.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 25 MB/s | 1.0 MB 00:00 2026-02-18T03:23:23.730 INFO:teuthology.orchestra.run.trial014.stdout:(44/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 19 MB/s | 5.3 MB 00:00 2026-02-18T03:23:23.748 INFO:teuthology.orchestra.run.trial014.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-18T03:23:23.758 INFO:teuthology.orchestra.run.trial014.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 2.7 MB/s | 77 kB 00:00 2026-02-18T03:23:23.768 INFO:teuthology.orchestra.run.trial086.stdout:(15/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-18T03:23:23.776 INFO:teuthology.orchestra.run.trial014.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 9.3 MB/s | 267 kB 00:00 2026-02-18T03:23:23.785 INFO:teuthology.orchestra.run.trial014.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.9 MB/s | 159 kB 00:00 2026-02-18T03:23:23.789 INFO:teuthology.orchestra.run.trial177.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 408 kB/s | 32 kB 00:00 2026-02-18T03:23:23.804 INFO:teuthology.orchestra.run.trial014.stdout:(49/95): python3-pyasn1-modules-0.4.8-6.el9.noa 9.6 MB/s | 279 kB 00:00 2026-02-18T03:23:23.814 INFO:teuthology.orchestra.run.trial014.stdout:(50/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 55 MB/s | 6.1 MB 00:00 2026-02-18T03:23:23.814 INFO:teuthology.orchestra.run.trial014.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 1.8 MB/s | 54 kB 00:00 2026-02-18T03:23:23.837 INFO:teuthology.orchestra.run.trial086.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 359 kB/s | 40 kB 00:00 2026-02-18T03:23:23.841 INFO:teuthology.orchestra.run.trial014.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-18T03:23:23.842 INFO:teuthology.orchestra.run.trial014.stdout:(53/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.4 MB/s | 42 kB 00:00 2026-02-18T03:23:23.853 INFO:teuthology.orchestra.run.trial014.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 22 kB 00:00 2026-02-18T03:23:23.868 INFO:teuthology.orchestra.run.trial014.stdout:(55/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.3 MB/s | 90 kB 00:00 2026-02-18T03:23:23.868 INFO:teuthology.orchestra.run.trial177.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 178 kB/s | 14 kB 00:00 2026-02-18T03:23:23.873 INFO:teuthology.orchestra.run.trial014.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 43 MB/s | 862 kB 00:00 2026-02-18T03:23:23.874 INFO:teuthology.orchestra.run.trial086.stdout:(17/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-18T03:23:23.878 INFO:teuthology.orchestra.run.trial086.stdout:(18/95): libconfig-1.7.2-9.el9.x86_64.rpm 656 kB/s | 72 kB 00:00 2026-02-18T03:23:23.899 INFO:teuthology.orchestra.run.trial014.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 756 kB/s | 19 kB 00:00 2026-02-18T03:23:23.908 INFO:teuthology.orchestra.run.trial155.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 127 kB/s | 6.5 kB 00:00 2026-02-18T03:23:23.919 INFO:teuthology.orchestra.run.trial014.stdout:(58/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 11 MB/s | 551 kB 00:00 2026-02-18T03:23:23.919 INFO:teuthology.orchestra.run.trial014.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 7.2 MB/s | 151 kB 00:00 2026-02-18T03:23:23.921 INFO:teuthology.orchestra.run.trial086.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 3.8 MB/s | 184 kB 00:00 2026-02-18T03:23:23.926 INFO:teuthology.orchestra.run.trial014.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 4.6 MB/s | 29 kB 00:00 2026-02-18T03:23:23.932 INFO:teuthology.orchestra.run.trial014.stdout:(61/95): python3-asyncssh-2.13.2-5.el9.noarch.r 41 MB/s | 548 kB 00:00 2026-02-18T03:23:23.934 INFO:teuthology.orchestra.run.trial014.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 6.9 MB/s | 60 kB 00:00 2026-02-18T03:23:23.940 INFO:teuthology.orchestra.run.trial014.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 5.6 MB/s | 43 kB 00:00 2026-02-18T03:23:23.940 INFO:teuthology.orchestra.run.trial014.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 5.6 MB/s | 32 kB 00:00 2026-02-18T03:23:23.947 INFO:teuthology.orchestra.run.trial014.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 2.0 MB/s | 14 kB 00:00 2026-02-18T03:23:23.948 INFO:teuthology.orchestra.run.trial014.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 21 MB/s | 173 kB 00:00 2026-02-18T03:23:23.955 INFO:teuthology.orchestra.run.trial014.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 43 MB/s | 358 kB 00:00 2026-02-18T03:23:23.984 INFO:teuthology.orchestra.run.trial014.stdout:(68/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 107 MB/s | 19 MB 00:00 2026-02-18T03:23:23.985 INFO:teuthology.orchestra.run.trial014.stdout:(69/95): python3-google-auth-2.45.0-1.el9.noarc 6.7 MB/s | 254 kB 00:00 2026-02-18T03:23:23.992 INFO:teuthology.orchestra.run.trial086.stdout:(20/95): libgfortran-11.5.0-14.el9.x86_64.rpm 5.0 MB/s | 794 kB 00:00 2026-02-18T03:23:24.007 INFO:teuthology.orchestra.run.trial014.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 6.5 MB/s | 139 kB 00:00 2026-02-18T03:23:24.009 INFO:teuthology.orchestra.run.trial014.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 38 MB/s | 2.0 MB 00:00 2026-02-18T03:23:24.013 INFO:teuthology.orchestra.run.trial014.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 8.6 MB/s | 56 kB 00:00 2026-02-18T03:23:24.014 INFO:teuthology.orchestra.run.trial014.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.2 MB/s | 11 kB 00:00 2026-02-18T03:23:24.019 INFO:teuthology.orchestra.run.trial014.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 3.0 MB/s | 18 kB 00:00 2026-02-18T03:23:24.020 INFO:teuthology.orchestra.run.trial014.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 4.1 MB/s | 23 kB 00:00 2026-02-18T03:23:24.021 INFO:teuthology.orchestra.run.trial014.stdout:(76/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.8 MB/s | 144 kB 00:00 2026-02-18T03:23:24.025 INFO:teuthology.orchestra.run.trial014.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 3.1 MB/s | 20 kB 00:00 2026-02-18T03:23:24.026 INFO:teuthology.orchestra.run.trial155.stdout:(2/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 14 MB/s | 2.3 MB 00:00 2026-02-18T03:23:24.026 INFO:teuthology.orchestra.run.trial014.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 2.9 MB/s | 19 kB 00:00 2026-02-18T03:23:24.027 INFO:teuthology.orchestra.run.trial014.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 4.7 MB/s | 26 kB 00:00 2026-02-18T03:23:24.027 INFO:teuthology.orchestra.run.trial177.stdout:(65/95): python3-cheroot-10.0.1-4.el9.noarch.rp 1.1 MB/s | 173 kB 00:00 2026-02-18T03:23:24.029 INFO:teuthology.orchestra.run.trial155.stdout:(3/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 5.5 MB/s | 961 kB 00:00 2026-02-18T03:23:24.036 INFO:teuthology.orchestra.run.trial014.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 9.4 MB/s | 86 kB 00:00 2026-02-18T03:23:24.036 INFO:teuthology.orchestra.run.trial086.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 106 kB 00:00 2026-02-18T03:23:24.037 INFO:teuthology.orchestra.run.trial014.stdout:(81/95): python3-more-itertools-8.12.0-2.el9.no 7.4 MB/s | 79 kB 00:00 2026-02-18T03:23:24.042 INFO:teuthology.orchestra.run.trial014.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 8.5 MB/s | 58 kB 00:00 2026-02-18T03:23:24.043 INFO:teuthology.orchestra.run.trial014.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 2.7 MB/s | 16 kB 00:00 2026-02-18T03:23:24.044 INFO:teuthology.orchestra.run.trial014.stdout:(84/95): python3-kubernetes-26.1.0-3.el9.noarch 54 MB/s | 1.0 MB 00:00 2026-02-18T03:23:24.048 INFO:teuthology.orchestra.run.trial014.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 15 MB/s | 90 kB 00:00 2026-02-18T03:23:24.050 INFO:teuthology.orchestra.run.trial014.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 4.1 MB/s | 31 kB 00:00 2026-02-18T03:23:24.052 INFO:teuthology.orchestra.run.trial014.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 23 MB/s | 188 kB 00:00 2026-02-18T03:23:24.056 INFO:teuthology.orchestra.run.trial014.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 8.0 MB/s | 59 kB 00:00 2026-02-18T03:23:24.060 INFO:teuthology.orchestra.run.trial014.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 13 MB/s | 125 kB 00:00 2026-02-18T03:23:24.060 INFO:teuthology.orchestra.run.trial014.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 4.4 MB/s | 36 kB 00:00 2026-02-18T03:23:24.062 INFO:teuthology.orchestra.run.trial014.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 14 MB/s | 86 kB 00:00 2026-02-18T03:23:24.068 INFO:teuthology.orchestra.run.trial014.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 6.3 MB/s | 48 kB 00:00 2026-02-18T03:23:24.068 INFO:teuthology.orchestra.run.trial014.stdout:(93/95): python3-websocket-client-1.2.3-2.el9.n 10 MB/s | 90 kB 00:00 2026-02-18T03:23:24.069 INFO:teuthology.orchestra.run.trial014.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 3.1 MB/s | 22 kB 00:00 2026-02-18T03:23:24.070 INFO:teuthology.orchestra.run.trial155.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 1.0 MB/s | 43 kB 00:00 2026-02-18T03:23:24.073 INFO:teuthology.orchestra.run.trial014.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 3.8 MB/s | 20 kB 00:00 2026-02-18T03:23:24.075 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:24.075 INFO:teuthology.orchestra.run.trial014.stdout:Total 27 MB/s | 101 MB 00:03 2026-02-18T03:23:24.076 INFO:teuthology.orchestra.run.trial086.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 3.3 MB/s | 135 kB 00:00 2026-02-18T03:23:24.117 INFO:teuthology.orchestra.run.trial155.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 3.6 MB/s | 173 kB 00:00 2026-02-18T03:23:24.123 INFO:teuthology.orchestra.run.trial086.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 3.1 MB/s | 150 kB 00:00 2026-02-18T03:23:24.127 INFO:teuthology.orchestra.run.trial086.stdout:(24/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2026-02-18T03:23:24.131 INFO:teuthology.orchestra.run.trial177.stdout:(66/95): python3-asyncssh-2.13.2-5.el9.noarch.r 772 kB/s | 548 kB 00:00 2026-02-18T03:23:24.160 INFO:teuthology.orchestra.run.trial086.stdout:(25/95): python3-cryptography-36.0.1-5.el9.x86_ 5.2 MB/s | 1.2 MB 00:00 2026-02-18T03:23:24.169 INFO:teuthology.orchestra.run.trial086.stdout:(26/95): python3-requests-2.25.1-10.el9.noarch. 2.7 MB/s | 126 kB 00:00 2026-02-18T03:23:24.176 INFO:teuthology.orchestra.run.trial155.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 19 MB/s | 5.1 MB 00:00 2026-02-18T03:23:24.185 INFO:teuthology.orchestra.run.trial177.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2026-02-18T03:23:24.189 INFO:teuthology.orchestra.run.trial086.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 3.4 MB/s | 218 kB 00:00 2026-02-18T03:23:24.203 INFO:teuthology.orchestra.run.trial086.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 7.6 MB/s | 266 kB 00:00 2026-02-18T03:23:24.208 INFO:teuthology.orchestra.run.trial086.stdout:(29/95): unzip-6.0-59.el9.x86_64.rpm 3.8 MB/s | 182 kB 00:00 2026-02-18T03:23:24.212 INFO:teuthology.orchestra.run.trial177.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 3.1 MB/s | 254 kB 00:00 2026-02-18T03:23:24.271 INFO:teuthology.orchestra.run.trial086.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 365 kB/s | 30 kB 00:00 2026-02-18T03:23:24.280 INFO:teuthology.orchestra.run.trial086.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 204 kB/s | 15 kB 00:00 2026-02-18T03:23:24.291 INFO:teuthology.orchestra.run.trial177.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 1.8 MB/s | 144 kB 00:00 2026-02-18T03:23:24.312 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:23:24.330 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:23:24.340 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:23:24.347 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:23:24.360 INFO:teuthology.orchestra.run.trial177.stdout:(70/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2026-02-18T03:23:24.360 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:23:24.370 INFO:teuthology.orchestra.run.trial086.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.4 MB/s | 246 kB 00:00 2026-02-18T03:23:24.375 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:23:24.382 INFO:teuthology.orchestra.run.trial177.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 1.5 MB/s | 139 kB 00:00 2026-02-18T03:23:24.382 INFO:teuthology.orchestra.run.trial086.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-18T03:23:24.397 INFO:teuthology.orchestra.run.trial086.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-18T03:23:24.439 INFO:teuthology.orchestra.run.trial177.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 710 kB/s | 56 kB 00:00 2026-02-18T03:23:24.450 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:23:24.458 INFO:teuthology.orchestra.run.trial086.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-18T03:23:24.459 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:23:24.460 INFO:teuthology.orchestra.run.trial177.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 136 kB/s | 11 kB 00:00 2026-02-18T03:23:24.477 INFO:teuthology.orchestra.run.trial086.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-02-18T03:23:24.483 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:23:24.506 INFO:teuthology.orchestra.run.trial086.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 8.4 MB/s | 244 kB 00:00 2026-02-18T03:23:24.511 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:24.513 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:23:24.518 INFO:teuthology.orchestra.run.trial177.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 222 kB/s | 18 kB 00:00 2026-02-18T03:23:24.537 INFO:teuthology.orchestra.run.trial086.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 75 MB/s | 6.0 MB 00:00 2026-02-18T03:23:24.538 INFO:teuthology.orchestra.run.trial086.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 7.5 MB/s | 249 kB 00:00 2026-02-18T03:23:24.539 INFO:teuthology.orchestra.run.trial177.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 294 kB/s | 23 kB 00:00 2026-02-18T03:23:24.547 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:24.547 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:24.551 INFO:teuthology.orchestra.run.trial155.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-67 20 MB/s | 7.4 MB 00:00 2026-02-18T03:23:24.563 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:23:24.567 INFO:teuthology.orchestra.run.trial086.stdout:(40/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 29 MB/s | 5.3 MB 00:00 2026-02-18T03:23:24.567 INFO:teuthology.orchestra.run.trial086.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 1.6 MB/s | 48 kB 00:00 2026-02-18T03:23:24.568 INFO:teuthology.orchestra.run.trial086.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 5.9 MB/s | 177 kB 00:00 2026-02-18T03:23:24.569 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:23:24.573 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:23:24.574 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:23:24.592 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:24.592 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:23:24.592 INFO:teuthology.orchestra.run.trial034.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:23:24.592 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:24.595 INFO:teuthology.orchestra.run.trial086.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.2 MB/s | 35 kB 00:00 2026-02-18T03:23:24.596 INFO:teuthology.orchestra.run.trial155.stdout:(8/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_6 30 MB/s | 17 MB 00:00 2026-02-18T03:23:24.596 INFO:teuthology.orchestra.run.trial155.stdout:(9/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 489 kB/s | 22 kB 00:00 2026-02-18T03:23:24.597 INFO:teuthology.orchestra.run.trial177.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 250 kB/s | 20 kB 00:00 2026-02-18T03:23:24.599 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:24.600 INFO:teuthology.orchestra.run.trial086.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-18T03:23:24.608 INFO:teuthology.orchestra.run.trial155.stdout:(10/95): ceph-mgr-modules-core-20.2.0-670.gadc1 23 MB/s | 290 kB 00:00 2026-02-18T03:23:24.609 INFO:teuthology.orchestra.run.trial155.stdout:(11/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 4.0 MB/s | 50 kB 00:00 2026-02-18T03:23:24.618 INFO:teuthology.orchestra.run.trial177.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 247 kB/s | 19 kB 00:00 2026-02-18T03:23:24.620 INFO:teuthology.orchestra.run.trial155.stdout:(12/95): ceph-prometheus-alerts-20.2.0-670.gadc 1.5 MB/s | 17 kB 00:00 2026-02-18T03:23:24.621 INFO:teuthology.orchestra.run.trial155.stdout:(13/95): ceph-volume-20.2.0-670.gadc19233.el9.n 24 MB/s | 297 kB 00:00 2026-02-18T03:23:24.623 INFO:teuthology.orchestra.run.trial086.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 16 MB/s | 442 kB 00:00 2026-02-18T03:23:24.624 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:24.624 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:23:24.624 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:24.627 INFO:teuthology.orchestra.run.trial086.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 2.8 MB/s | 77 kB 00:00 2026-02-18T03:23:24.642 INFO:teuthology.orchestra.run.trial155.stdout:(14/95): cephadm-20.2.0-670.gadc19233.el9.noarc 44 MB/s | 1.0 MB 00:00 2026-02-18T03:23:24.654 INFO:teuthology.orchestra.run.trial086.stdout:(47/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.8 MB/s | 159 kB 00:00 2026-02-18T03:23:24.655 INFO:teuthology.orchestra.run.trial086.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 8.1 MB/s | 267 kB 00:00 2026-02-18T03:23:24.657 INFO:teuthology.orchestra.run.trial177.stdout:(78/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 294 kB/s | 551 kB 00:01 2026-02-18T03:23:24.658 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:23:24.676 INFO:teuthology.orchestra.run.trial177.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 334 kB/s | 26 kB 00:00 2026-02-18T03:23:24.681 INFO:teuthology.orchestra.run.trial086.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-18T03:23:24.683 INFO:teuthology.orchestra.run.trial086.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 9.5 MB/s | 279 kB 00:00 2026-02-18T03:23:24.705 INFO:teuthology.orchestra.run.trial155.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 648 kB/s | 40 kB 00:00 2026-02-18T03:23:24.709 INFO:teuthology.orchestra.run.trial086.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-18T03:23:24.722 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:23:24.722 INFO:teuthology.orchestra.run.trial086.stdout:(52/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 40 MB/s | 6.1 MB 00:00 2026-02-18T03:23:24.724 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:24.728 INFO:teuthology.orchestra.run.trial155.stdout:(16/95): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-18T03:23:24.731 INFO:teuthology.orchestra.run.trial155.stdout:(17/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.1 MB/s | 350 kB 00:00 2026-02-18T03:23:24.736 INFO:teuthology.orchestra.run.trial086.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.9 MB/s | 189 kB 00:00 2026-02-18T03:23:24.737 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:24.737 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:24.737 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:23:24.737 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:24.749 INFO:teuthology.orchestra.run.trial086.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.4 MB/s | 90 kB 00:00 2026-02-18T03:23:24.754 INFO:teuthology.orchestra.run.trial155.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 7.7 MB/s | 184 kB 00:00 2026-02-18T03:23:24.763 INFO:teuthology.orchestra.run.trial177.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 988 kB/s | 86 kB 00:00 2026-02-18T03:23:24.772 INFO:teuthology.orchestra.run.trial155.stdout:(19/95): ceph-mgr-dashboard-20.2.0-670.gadc1923 16 MB/s | 11 MB 00:00 2026-02-18T03:23:24.777 INFO:teuthology.orchestra.run.trial177.stdout:(81/95): python3-kubernetes-26.1.0-3.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2026-02-18T03:23:24.781 INFO:teuthology.orchestra.run.trial155.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.3 MB/s | 253 kB 00:00 2026-02-18T03:23:24.794 INFO:teuthology.orchestra.run.trial155.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-18T03:23:24.804 INFO:teuthology.orchestra.run.trial155.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-18T03:23:24.814 INFO:teuthology.orchestra.run.trial177.stdout:(82/95): python3-more-itertools-8.12.0-2.el9.no 504 kB/s | 79 kB 00:00 2026-02-18T03:23:24.818 INFO:teuthology.orchestra.run.trial155.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-18T03:23:24.833 INFO:teuthology.orchestra.run.trial155.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 5.2 MB/s | 150 kB 00:00 2026-02-18T03:23:24.841 INFO:teuthology.orchestra.run.trial155.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 5.6 MB/s | 126 kB 00:00 2026-02-18T03:23:24.842 INFO:teuthology.orchestra.run.trial177.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 731 kB/s | 58 kB 00:00 2026-02-18T03:23:24.856 INFO:teuthology.orchestra.run.trial177.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 208 kB/s | 16 kB 00:00 2026-02-18T03:23:24.858 INFO:teuthology.orchestra.run.trial155.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 8.2 MB/s | 218 kB 00:00 2026-02-18T03:23:24.859 INFO:teuthology.orchestra.run.trial086.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 109 MB/s | 19 MB 00:00 2026-02-18T03:23:24.864 INFO:teuthology.orchestra.run.trial155.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-18T03:23:24.887 INFO:teuthology.orchestra.run.trial155.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 9.1 MB/s | 266 kB 00:00 2026-02-18T03:23:24.919 INFO:teuthology.orchestra.run.trial155.stdout:(29/95): python3-cryptography-36.0.1-5.el9.x86_ 8.5 MB/s | 1.2 MB 00:00 2026-02-18T03:23:24.921 INFO:teuthology.orchestra.run.trial177.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 390 kB/s | 31 kB 00:00 2026-02-18T03:23:24.942 INFO:teuthology.orchestra.run.trial177.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2026-02-18T03:23:24.976 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:24.976 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:24.995 INFO:teuthology.orchestra.run.trial086.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 4.0 MB/s | 551 kB 00:00 2026-02-18T03:23:25.002 INFO:teuthology.orchestra.run.trial177.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 737 kB/s | 59 kB 00:00 2026-02-18T03:23:25.023 INFO:teuthology.orchestra.run.trial177.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-18T03:23:25.026 INFO:teuthology.orchestra.run.trial086.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 619 kB/s | 19 kB 00:00 2026-02-18T03:23:25.048 INFO:teuthology.orchestra.run.trial177.stdout:(89/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 384 kB/s | 90 kB 00:00 2026-02-18T03:23:25.059 INFO:teuthology.orchestra.run.trial086.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2026-02-18T03:23:25.080 INFO:teuthology.orchestra.run.trial177.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 454 kB/s | 36 kB 00:00 2026-02-18T03:23:25.103 INFO:teuthology.orchestra.run.trial177.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 1.1 MB/s | 86 kB 00:00 2026-02-18T03:23:25.111 INFO:teuthology.orchestra.run.trial086.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 10 MB/s | 548 kB 00:00 2026-02-18T03:23:25.140 INFO:teuthology.orchestra.run.trial086.stdout:(60/95): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2026-02-18T03:23:25.147 INFO:teuthology.orchestra.run.trial086.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 829 kB/s | 29 kB 00:00 2026-02-18T03:23:25.159 INFO:teuthology.orchestra.run.trial177.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 613 kB/s | 48 kB 00:00 2026-02-18T03:23:25.174 INFO:teuthology.orchestra.run.trial086.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-18T03:23:25.182 INFO:teuthology.orchestra.run.trial177.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 281 kB/s | 22 kB 00:00 2026-02-18T03:23:25.207 INFO:teuthology.orchestra.run.trial177.stdout:(94/95): python3-websocket-client-1.2.3-2.el9.n 566 kB/s | 90 kB 00:00 2026-02-18T03:23:25.208 INFO:teuthology.orchestra.run.trial086.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 973 kB/s | 32 kB 00:00 2026-02-18T03:23:25.225 INFO:teuthology.orchestra.run.trial086.stdout:(64/95): python3-backports-tarfile-1.2.0-1.el9. 712 kB/s | 60 kB 00:00 2026-02-18T03:23:25.237 INFO:teuthology.orchestra.run.trial086.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 480 kB/s | 14 kB 00:00 2026-02-18T03:23:25.239 INFO:teuthology.orchestra.run.trial177.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 253 kB/s | 20 kB 00:00 2026-02-18T03:23:25.247 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:25.247 INFO:teuthology.orchestra.run.trial177.stdout:Total 17 MB/s | 101 MB 00:05 2026-02-18T03:23:25.274 INFO:teuthology.orchestra.run.trial155.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 72 kB/s | 30 kB 00:00 2026-02-18T03:23:25.277 INFO:teuthology.orchestra.run.trial086.stdout:(66/95): python3-cherrypy-18.6.1-2.el9.noarch.r 8.8 MB/s | 358 kB 00:00 2026-02-18T03:23:25.287 INFO:teuthology.orchestra.run.trial086.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 2.8 MB/s | 173 kB 00:00 2026-02-18T03:23:25.308 INFO:teuthology.orchestra.run.trial086.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 8.2 MB/s | 254 kB 00:00 2026-02-18T03:23:25.323 INFO:teuthology.orchestra.run.trial155.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 37 kB/s | 15 kB 00:00 2026-02-18T03:23:25.348 INFO:teuthology.orchestra.run.trial086.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.5 MB/s | 144 kB 00:00 2026-02-18T03:23:25.377 INFO:teuthology.orchestra.run.trial086.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 4.6 MB/s | 139 kB 00:00 2026-02-18T03:23:25.391 INFO:teuthology.orchestra.run.trial086.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 20 MB/s | 2.0 MB 00:00 2026-02-18T03:23:25.409 INFO:teuthology.orchestra.run.trial086.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.7 MB/s | 56 kB 00:00 2026-02-18T03:23:25.416 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:25.419 INFO:teuthology.orchestra.run.trial086.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 378 kB/s | 11 kB 00:00 2026-02-18T03:23:25.428 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:25.430 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:23:25.434 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:23:25.440 INFO:teuthology.orchestra.run.trial086.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 573 kB/s | 18 kB 00:00 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:25.441 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:25.447 INFO:teuthology.orchestra.run.trial086.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 810 kB/s | 23 kB 00:00 2026-02-18T03:23:25.455 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:23:25.472 INFO:teuthology.orchestra.run.trial086.stdout:(76/95): protobuf-compiler-3.14.0-17.el9.x86_64 1.2 MB/s | 862 kB 00:00 2026-02-18T03:23:25.474 INFO:teuthology.orchestra.run.trial086.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 587 kB/s | 20 kB 00:00 2026-02-18T03:23:25.477 INFO:teuthology.orchestra.run.trial086.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 659 kB/s | 19 kB 00:00 2026-02-18T03:23:25.489 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:23:25.498 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:23:25.503 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:25.504 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:23:25.504 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:25.506 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:23:25.508 INFO:teuthology.orchestra.run.trial086.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 2.5 MB/s | 79 kB 00:00 2026-02-18T03:23:25.510 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:23:25.511 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:23:25.523 INFO:teuthology.orchestra.run.trial155.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 989 kB/s | 246 kB 00:00 2026-02-18T03:23:25.527 INFO:teuthology.orchestra.run.trial086.stdout:(80/95): python3-kubernetes-26.1.0-3.el9.noarch 19 MB/s | 1.0 MB 00:00 2026-02-18T03:23:25.530 INFO:teuthology.orchestra.run.trial086.stdout:(81/95): python3-jaraco-text-4.0.0-2.el9.noarch 462 kB/s | 26 kB 00:00 2026-02-18T03:23:25.534 INFO:teuthology.orchestra.run.trial014.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:23:25.534 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:23:25.536 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:25.541 INFO:teuthology.orchestra.run.trial086.stdout:(82/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2026-02-18T03:23:25.547 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:23:25.550 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:23:25.556 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:23:25.558 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:23:25.564 INFO:teuthology.orchestra.run.trial155.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 780 kB/s | 188 kB 00:00 2026-02-18T03:23:25.569 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:23:25.575 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:23:25.599 INFO:teuthology.orchestra.run.trial014.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:23:25.603 INFO:teuthology.orchestra.run.trial014.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:23:25.609 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:23:25.611 INFO:teuthology.orchestra.run.trial155.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 480 kB/s | 42 kB 00:00 2026-02-18T03:23:25.661 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:23:25.673 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:25.674 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:23:25.676 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:23:25.681 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:23:25.686 INFO:teuthology.orchestra.run.trial086.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 105 kB/s | 16 kB 00:00 2026-02-18T03:23:25.686 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:23:25.691 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:23:25.691 INFO:teuthology.orchestra.run.trial086.stdout:(84/95): python3-natsort-7.1.1-5.el9.noarch.rpm 351 kB/s | 58 kB 00:00 2026-02-18T03:23:25.694 INFO:teuthology.orchestra.run.trial086.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 589 kB/s | 90 kB 00:00 2026-02-18T03:23:25.694 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:23:25.708 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:23:25.710 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:25.710 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:25.713 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:23:25.718 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:23:25.729 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:23:25.736 INFO:teuthology.orchestra.run.trial086.stdout:(86/95): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-18T03:23:25.738 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:23:25.745 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:23:25.747 INFO:teuthology.orchestra.run.trial086.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2026-02-18T03:23:25.753 INFO:teuthology.orchestra.run.trial086.stdout:(88/95): python3-repoze-lru-0.7-16.el9.noarch.r 458 kB/s | 31 kB 00:00 2026-02-18T03:23:25.765 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:23:25.767 INFO:teuthology.orchestra.run.trial155.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 3.4 MB/s | 3.0 MB 00:00 2026-02-18T03:23:25.776 INFO:teuthology.orchestra.run.trial086.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-18T03:23:25.776 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:23:25.782 INFO:teuthology.orchestra.run.trial086.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-18T03:23:25.792 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:23:25.796 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:23:25.803 INFO:teuthology.orchestra.run.trial086.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 1.7 MB/s | 86 kB 00:00 2026-02-18T03:23:25.804 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:23:25.805 INFO:teuthology.orchestra.run.trial086.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 3.0 MB/s | 90 kB 00:00 2026-02-18T03:23:25.808 INFO:teuthology.orchestra.run.trial086.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.8 MB/s | 48 kB 00:00 2026-02-18T03:23:25.841 INFO:teuthology.orchestra.run.trial086.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 561 kB/s | 20 kB 00:00 2026-02-18T03:23:25.841 INFO:teuthology.orchestra.run.trial086.stdout:(95/95): python3-xmltodict-0.12.0-15.el9.noarch 576 kB/s | 22 kB 00:00 2026-02-18T03:23:25.844 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:25.844 INFO:teuthology.orchestra.run.trial086.stdout:Total 29 MB/s | 101 MB 00:03 2026-02-18T03:23:25.845 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:23:25.864 INFO:teuthology.orchestra.run.trial155.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2026-02-18T03:23:25.951 INFO:teuthology.orchestra.run.trial155.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-18T03:23:25.988 INFO:teuthology.orchestra.run.trial155.stdout:(38/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 12 MB/s | 5.3 MB 00:00 2026-02-18T03:23:25.995 INFO:teuthology.orchestra.run.trial155.stdout:(39/95): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2026-02-18T03:23:26.040 INFO:teuthology.orchestra.run.trial155.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.7 MB/s | 249 kB 00:00 2026-02-18T03:23:26.079 INFO:teuthology.orchestra.run.trial155.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 524 kB/s | 48 kB 00:00 2026-02-18T03:23:26.080 INFO:teuthology.orchestra.run.trial155.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 2.0 MB/s | 177 kB 00:00 2026-02-18T03:23:26.142 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:26.143 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:26.162 INFO:teuthology.orchestra.run.trial155.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2026-02-18T03:23:26.173 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:23:26.183 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:23:26.187 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:23:26.193 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:23:26.195 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:23:26.214 INFO:teuthology.orchestra.run.trial155.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 7.1 MB/s | 1.2 MB 00:00 2026-02-18T03:23:26.223 INFO:teuthology.orchestra.run.trial014.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:23:26.249 INFO:teuthology.orchestra.run.trial155.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.0 MB/s | 442 kB 00:00 2026-02-18T03:23:26.267 INFO:teuthology.orchestra.run.trial014.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:23:26.268 INFO:teuthology.orchestra.run.trial155.stdout:(46/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 33 MB/s | 6.1 MB 00:00 2026-02-18T03:23:26.274 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:23:26.278 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:23:26.284 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:23:26.287 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:23:26.291 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:26.294 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:23:26.298 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:23:26.301 INFO:teuthology.orchestra.run.trial155.stdout:(47/95): python3-packaging-20.9-5.el9.noarch.rp 881 kB/s | 77 kB 00:00 2026-02-18T03:23:26.326 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:23:26.329 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:26.329 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:26.336 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:23:26.338 INFO:teuthology.orchestra.run.trial155.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 3.0 MB/s | 267 kB 00:00 2026-02-18T03:23:26.342 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:23:26.349 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:23:26.354 INFO:teuthology.orchestra.run.trial155.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2026-02-18T03:23:26.384 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:23:26.388 INFO:teuthology.orchestra.run.trial155.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 3.1 MB/s | 279 kB 00:00 2026-02-18T03:23:26.422 INFO:teuthology.orchestra.run.trial155.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 635 kB/s | 54 kB 00:00 2026-02-18T03:23:26.473 INFO:teuthology.orchestra.run.trial155.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 493 kB/s | 42 kB 00:00 2026-02-18T03:23:26.507 INFO:teuthology.orchestra.run.trial155.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.2 MB/s | 189 kB 00:00 2026-02-18T03:23:26.559 INFO:teuthology.orchestra.run.trial155.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.0 MB/s | 90 kB 00:00 2026-02-18T03:23:26.597 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:26.599 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:23:26.605 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:23:26.610 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:23:26.626 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:23:26.626 INFO:teuthology.orchestra.run.trial155.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 187 kB/s | 22 kB 00:00 2026-02-18T03:23:26.634 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:23:26.637 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:23:26.659 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:23:26.668 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:23:26.670 INFO:teuthology.orchestra.run.trial155.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 7.6 MB/s | 862 kB 00:00 2026-02-18T03:23:26.673 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:23:26.676 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:23:26.680 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:23:26.693 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:26.696 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:23:26.698 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:23:26.699 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:26.703 INFO:teuthology.orchestra.run.trial177.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:23:26.716 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:23:26.719 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:23:26.719 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:23:26.725 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:23:26.727 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:23:26.738 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:23:26.744 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:23:26.760 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:26.761 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:26.768 INFO:teuthology.orchestra.run.trial177.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:23:26.771 INFO:teuthology.orchestra.run.trial177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:23:26.778 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:23:26.825 INFO:teuthology.orchestra.run.trial155.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 126 kB/s | 19 kB 00:00 2026-02-18T03:23:26.828 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:23:26.841 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:23:26.845 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:23:26.850 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:23:26.855 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:23:26.859 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:23:26.862 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:23:26.877 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:23:26.881 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:23:26.887 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:23:26.898 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:23:26.907 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:23:26.914 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:23:26.933 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:23:26.944 INFO:teuthology.orchestra.run.trial155.stdout:(58/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-18T03:23:26.944 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:23:26.960 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:23:26.964 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:23:26.972 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:23:27.012 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:23:27.014 INFO:teuthology.orchestra.run.trial155.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 800 kB/s | 151 kB 00:00 2026-02-18T03:23:27.030 INFO:teuthology.orchestra.run.trial155.stdout:(60/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.3 MB/s | 551 kB 00:00 2026-02-18T03:23:27.046 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:23:27.072 INFO:teuthology.orchestra.run.trial155.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 516 kB/s | 29 kB 00:00 2026-02-18T03:23:27.086 INFO:teuthology.orchestra.run.trial155.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-18T03:23:27.120 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:23:27.132 INFO:teuthology.orchestra.run.trial155.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 718 kB/s | 43 kB 00:00 2026-02-18T03:23:27.140 INFO:teuthology.orchestra.run.trial155.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 596 kB/s | 32 kB 00:00 2026-02-18T03:23:27.152 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:27.153 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:27.164 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:27.165 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:27.186 INFO:teuthology.orchestra.run.trial155.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 262 kB/s | 14 kB 00:00 2026-02-18T03:23:27.203 INFO:teuthology.orchestra.run.trial155.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 2.7 MB/s | 173 kB 00:00 2026-02-18T03:23:27.216 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:27.218 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:23:27.221 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:27.222 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:23:27.244 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:23:27.264 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:23:27.265 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:27.273 INFO:teuthology.orchestra.run.trial155.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 3.6 MB/s | 254 kB 00:00 2026-02-18T03:23:27.278 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:27.287 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:27.292 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:23:27.295 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:23:27.299 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:23:27.300 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:27.315 INFO:teuthology.orchestra.run.trial155.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 2.7 MB/s | 358 kB 00:00 2026-02-18T03:23:27.323 INFO:teuthology.orchestra.run.trial086.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:23:27.333 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:23:27.335 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:23:27.338 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:23:27.343 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:23:27.344 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:23:27.346 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:23:27.347 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:23:27.353 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:23:27.355 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:23:27.357 INFO:teuthology.orchestra.run.trial155.stdout:(69/95): python3-asyncssh-2.13.2-5.el9.noarch.r 1.3 MB/s | 548 kB 00:00 2026-02-18T03:23:27.357 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:23:27.363 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:23:27.376 INFO:teuthology.orchestra.run.trial155.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 2.3 MB/s | 144 kB 00:00 2026-02-18T03:23:27.383 INFO:teuthology.orchestra.run.trial177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:23:27.388 INFO:teuthology.orchestra.run.trial086.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:23:27.391 INFO:teuthology.orchestra.run.trial086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:23:27.398 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:23:27.424 INFO:teuthology.orchestra.run.trial155.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 2.0 MB/s | 139 kB 00:00 2026-02-18T03:23:27.426 INFO:teuthology.orchestra.run.trial177.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:23:27.431 INFO:teuthology.orchestra.run.trial155.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.0 MB/s | 56 kB 00:00 2026-02-18T03:23:27.433 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:23:27.437 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:23:27.442 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:23:27.443 INFO:teuthology.orchestra.run.trial155.stdout:(73/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2026-02-18T03:23:27.446 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:23:27.449 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:23:27.453 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:23:27.456 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:23:27.462 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:23:27.464 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:23:27.469 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:23:27.474 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:23:27.478 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:23:27.482 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:23:27.482 INFO:teuthology.orchestra.run.trial155.stdout:(74/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 185 kB/s | 11 kB 00:00 2026-02-18T03:23:27.483 INFO:teuthology.orchestra.run.trial155.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 340 kB/s | 18 kB 00:00 2026-02-18T03:23:27.484 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:23:27.494 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:23:27.496 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:23:27.497 INFO:teuthology.orchestra.run.trial155.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 435 kB/s | 23 kB 00:00 2026-02-18T03:23:27.501 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:23:27.501 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:23:27.506 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:23:27.508 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:23:27.517 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:23:27.524 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:27.526 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:27.526 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:23:27.532 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:23:27.536 INFO:teuthology.orchestra.run.trial155.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 371 kB/s | 20 kB 00:00 2026-02-18T03:23:27.541 INFO:teuthology.orchestra.run.trial155.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 334 kB/s | 19 kB 00:00 2026-02-18T03:23:27.542 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:23:27.546 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:27.546 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:27.546 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:23:27.546 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:27.547 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:27.547 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:27.550 INFO:teuthology.orchestra.run.trial155.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 499 kB/s | 26 kB 00:00 2026-02-18T03:23:27.552 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:23:27.563 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:23:27.579 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:23:27.583 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:23:27.591 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:23:27.600 INFO:teuthology.orchestra.run.trial155.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2026-02-18T03:23:27.604 INFO:teuthology.orchestra.run.trial155.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2026-02-18T03:23:27.631 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:23:27.643 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:27.656 INFO:teuthology.orchestra.run.trial155.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.0 MB/s | 58 kB 00:00 2026-02-18T03:23:27.657 INFO:teuthology.orchestra.run.trial155.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 312 kB/s | 16 kB 00:00 2026-02-18T03:23:27.664 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:27.664 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:27.664 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:23:27.664 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:27.664 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:27.665 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:27.682 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:27.710 INFO:teuthology.orchestra.run.trial155.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 581 kB/s | 31 kB 00:00 2026-02-18T03:23:27.715 INFO:teuthology.orchestra.run.trial155.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2026-02-18T03:23:27.764 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:23:27.765 INFO:teuthology.orchestra.run.trial155.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2026-02-18T03:23:27.772 INFO:teuthology.orchestra.run.trial155.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2026-02-18T03:23:27.788 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:23:27.792 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:23:27.798 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:23:27.815 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:23:27.820 INFO:teuthology.orchestra.run.trial155.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 2.2 MB/s | 125 kB 00:00 2026-02-18T03:23:27.826 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:23:27.828 INFO:teuthology.orchestra.run.trial155.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 639 kB/s | 36 kB 00:00 2026-02-18T03:23:27.832 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:23:27.846 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:23:27.850 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:23:27.852 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:23:27.862 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:23:27.874 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:23:27.875 INFO:teuthology.orchestra.run.trial155.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 1.6 MB/s | 86 kB 00:00 2026-02-18T03:23:27.887 INFO:teuthology.orchestra.run.trial155.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2026-02-18T03:23:27.928 INFO:teuthology.orchestra.run.trial155.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 903 kB/s | 48 kB 00:00 2026-02-18T03:23:27.938 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:23:27.942 INFO:teuthology.orchestra.run.trial155.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 404 kB/s | 22 kB 00:00 2026-02-18T03:23:27.947 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:23:27.957 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:23:27.967 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:23:27.970 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:23:27.971 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:23:27.977 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:23:27.979 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:23:27.981 INFO:teuthology.orchestra.run.trial155.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 377 kB/s | 20 kB 00:00 2026-02-18T03:23:28.000 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:23:28.007 INFO:teuthology.orchestra.run.trial086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:23:28.021 INFO:teuthology.orchestra.run.trial155.stdout:(95/95): python3-kubernetes-26.1.0-3.el9.noarch 2.1 MB/s | 1.0 MB 00:00 2026-02-18T03:23:28.025 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:28.025 INFO:teuthology.orchestra.run.trial155.stdout:Total 21 MB/s | 101 MB 00:04 2026-02-18T03:23:28.051 INFO:teuthology.orchestra.run.trial086.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:23:28.051 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:23:28.057 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:23:28.058 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:23:28.061 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:23:28.062 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:23:28.063 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:23:28.067 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:23:28.070 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:23:28.078 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:23:28.081 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:28.081 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:23:28.081 INFO:teuthology.orchestra.run.trial014.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:23:28.081 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:28.082 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:23:28.089 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:28.109 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:23:28.117 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:28.117 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:23:28.117 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:28.119 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:23:28.125 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:23:28.132 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:23:28.154 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:23:28.167 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:23:28.197 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:23:28.218 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:23:28.220 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:28.234 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:28.235 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:28.235 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:23:28.235 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:28.270 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:23:28.392 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:23:28.404 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:23:28.405 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:23:28.406 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:23:28.416 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:23:28.420 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:23:28.470 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:23:28.471 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:23:28.472 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:28.473 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:28.478 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:23:28.480 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:23:28.501 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:23:28.507 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:28.507 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:28.526 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-base 2026-02-18T03:23:28.831 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:23:28.838 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:28.902 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:28.905 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:23:28.920 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:28.920 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:28.920 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:28.936 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:28.937 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:28.937 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:28.939 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:23:28.941 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install cephadm 2026-02-18T03:23:28.956 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:23:28.962 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:28.963 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:28.963 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:23:28.963 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:28.963 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:28.963 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:28.966 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:23:28.973 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:23:28.986 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:23:29.001 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:23:29.025 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:29.027 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:29.034 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:23:29.057 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:23:29.059 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:29.076 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:23:29.085 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:23:29.108 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:23:29.138 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:23:29.188 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:23:29.194 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:23:29.197 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:23:29.199 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:23:29.216 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.217 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:23:29.217 INFO:teuthology.orchestra.run.trial177.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:23:29.217 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:29.224 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.249 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:29.249 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.250 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:23:29.250 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:29.283 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:23:29.313 INFO:teuthology.orchestra.run.trial034.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:29.330 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:29.331 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:29.331 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:29.346 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:23:29.348 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:29.351 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:23:29.361 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:29.362 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:29.362 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:23:29.362 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:29.389 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:29.391 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T03:23:29.395 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T03:23:29.416 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T03:23:29.448 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T03:23:29.458 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T03:23:29.464 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T03:23:29.466 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T03:23:29.471 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T03:23:29.493 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T03:23:29.506 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T03:23:29.510 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T03:23:29.516 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T03:23:29.517 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T03:23:29.529 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T03:23:29.535 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T03:23:29.558 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T03:23:29.562 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T03:23:29.568 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T03:23:29.576 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:23:29.594 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:23:29.604 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:23:29.611 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:23:29.618 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T03:23:29.624 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:23:29.631 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T03:23:29.634 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T03:23:29.638 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T03:23:29.640 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:23:29.644 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T03:23:29.648 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T03:23:29.651 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T03:23:29.656 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:29.666 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T03:23:29.670 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T03:23:29.675 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T03:23:29.686 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T03:23:29.695 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T03:23:29.701 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T03:23:29.715 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:23:29.720 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T03:23:29.724 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:23:29.731 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T03:23:29.738 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:29.739 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:29.740 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:29.740 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:29.740 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 154 k 2026-02-18T03:23:29.740 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 447 k 2026-02-18T03:23:29.740 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:29.747 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T03:23:29.748 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:23:29.751 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T03:23:29.759 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T03:23:29.777 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:23:29.798 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T03:23:29.824 INFO:teuthology.orchestra.run.trial034.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:29.824 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:29.825 INFO:teuthology.orchestra.run.trial034.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-18T03:23:29.825 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:29.828 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:23:29.829 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:29.829 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:29.834 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:23:29.837 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:23:29.839 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:23:29.857 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.857 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:23:29.857 INFO:teuthology.orchestra.run.trial086.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:23:29.857 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:29.861 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:29.861 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:29.865 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.892 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:29.892 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:23:29.892 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:29.916 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:29.918 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:29.929 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:23:29.940 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:29.940 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:29.940 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:23:29.940 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:29.993 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:23:29.995 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:30.010 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:30.010 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:30.010 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:23:30.010 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:30.045 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:30.069 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:30.070 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:30.070 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:23:30.070 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:30.070 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:30.070 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:30.118 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T03:23:30.127 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T03:23:30.129 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:30.131 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:30.131 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T03:23:30.137 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T03:23:30.138 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:23:30.139 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T03:23:30.161 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:23:30.163 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:30.166 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T03:23:30.210 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T03:23:30.216 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T03:23:30.218 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:30.220 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T03:23:30.223 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:30.225 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T03:23:30.229 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T03:23:30.236 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T03:23:30.239 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:30.259 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:30.267 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T03:23:30.276 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T03:23:30.282 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T03:23:30.286 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr 2026-02-18T03:23:30.289 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T03:23:30.323 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T03:23:30.545 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T03:23:30.568 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T03:23:30.572 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T03:23:30.594 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:30.629 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T03:23:30.631 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T03:23:30.652 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T03:23:30.659 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:30.677 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:30.677 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:30.677 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:30.685 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:30.690 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:30.691 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:30.698 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:23:30.705 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:30.706 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:30.709 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:30.709 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:30.709 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:23:30.709 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:30.709 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:30.710 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:30.767 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:30.768 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:30.770 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:30.777 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:23:30.800 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:23:30.801 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:30.812 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:23:30.814 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:30.835 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:30.847 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:30.972 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T03:23:31.006 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:31.044 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T03:23:31.070 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:31.079 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:31.081 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:31.088 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:31.088 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:31.088 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:31.102 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:31.103 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:31.103 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:23:31.103 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:31.103 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:31.103 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:31.109 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:23:31.203 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:31.223 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:31.224 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:31.224 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:23:31.224 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:31.224 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:31.224 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:31.243 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:31.311 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:31.316 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:31.421 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:31.485 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:31.503 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:31.503 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:31.503 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:31.524 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:23:31.707 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T03:23:31.725 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T03:23:31.735 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T03:23:31.741 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T03:23:31.755 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T03:23:31.770 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T03:23:31.774 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:31.775 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:31.787 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:31.787 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:31.832 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:31.844 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:31.846 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T03:23:31.854 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T03:23:31.878 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T03:23:31.887 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:23:31.889 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:31.896 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:31.907 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T03:23:31.910 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:31.911 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:31.911 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:23:31.911 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:31.911 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:31.911 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:31.914 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:31.915 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:31.915 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:31.922 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:31.936 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:23:31.951 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:23:31.952 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:23:31.953 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:23:31.954 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:23:31.955 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:23:31.956 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:23:31.957 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:23:31.958 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:23:31.959 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:23:31.960 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:23:31.961 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T03:23:31.961 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:31.962 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:31.964 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T03:23:31.967 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T03:23:31.968 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T03:23:31.987 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:31.987 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T03:23:31.987 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T03:23:31.987 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:31.996 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:32.012 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:23:32.012 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:32.012 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:32.013 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:23:32.013 INFO:teuthology.orchestra.run.trial014.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:32.013 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.013 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:32.013 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.014 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:32.015 INFO:teuthology.orchestra.run.trial014.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:23:32.016 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:23:32.017 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:23:32.018 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:23:32.019 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:23:32.020 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:23:32.021 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:23:32.022 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:23:32.022 INFO:teuthology.orchestra.run.trial014.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:23:32.022 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:32.022 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:32.023 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T03:23:32.023 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T03:23:32.023 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:32.057 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T03:23:32.068 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-base 2026-02-18T03:23:32.120 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T03:23:32.122 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:32.136 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T03:23:32.136 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.136 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T03:23:32.136 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:32.149 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:32.151 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:32.172 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:32.172 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.172 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:23:32.173 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:32.173 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:32.173 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:32.242 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:32.271 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:32.291 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:32.291 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.291 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:23:32.292 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:32.292 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:32.292 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:32.305 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:32.310 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:32.323 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:32.323 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:32.324 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:32.344 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-fuse 2026-02-18T03:23:32.377 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:32.410 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:32.411 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:32.425 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:32.425 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:32.442 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:32.459 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:32.460 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:32.460 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:32.482 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install cephadm 2026-02-18T03:23:32.483 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:32.526 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:23:32.527 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:32.548 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:32.548 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.549 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:23:32.549 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:32.549 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:32.549 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:32.560 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:32.652 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:32.734 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:32.735 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:32.736 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:32.736 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:32.736 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 942 k 2026-02-18T03:23:32.736 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 2.7 M 2026-02-18T03:23:32.736 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:32.787 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:32.789 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:32.792 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:32.810 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:32.811 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.811 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:23:32.811 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:32.811 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:32.811 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:32.812 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:32.837 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T03:23:32.837 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.837 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T03:23:32.837 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:32.837 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T03:23:32.838 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:32.851 INFO:teuthology.orchestra.run.trial034.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.9 MB/s | 942 kB 00:00 2026-02-18T03:23:32.863 INFO:teuthology.orchestra.run.trial014.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:32.863 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:32.863 INFO:teuthology.orchestra.run.trial034.stdout:Total 7.9 MB/s | 942 kB 00:00 2026-02-18T03:23:32.863 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:32.864 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:32.864 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:32.874 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:32.875 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:32.875 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:32.890 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:32.891 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:32.895 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:32.897 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:23:32.900 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T03:23:32.904 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T03:23:32.908 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:32.927 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:32.928 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:32.929 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:32.946 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:32.979 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:32.996 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:33.030 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:33.030 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:23:33.031 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:23:33.032 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:23:33.033 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:23:33.034 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:23:33.035 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:23:33.036 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:23:33.037 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:23:33.038 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:23:33.039 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:23:33.094 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:23:33.094 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:33.094 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.095 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.096 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:23:33.097 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:23:33.098 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:23:33.099 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:33.100 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:23:33.101 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:23:33.102 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:33.103 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:33.151 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-base 2026-02-18T03:23:33.205 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:33.243 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:33.286 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:33.287 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:33.287 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-18T03:23:33.287 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:33.287 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 154 k 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 447 k 2026-02-18T03:23:33.288 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:33.299 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:33.300 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:33.300 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:33.300 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.300 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:33.300 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:33.327 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-volume 2026-02-18T03:23:33.371 INFO:teuthology.orchestra.run.trial014.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:33.372 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:33.372 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:33.372 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:33.377 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:33.377 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:33.409 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:33.409 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:33.465 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:33.466 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:33.467 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:33.490 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:33.490 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:33.490 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:23:33.490 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:33.528 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:33.546 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:33.547 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:33.547 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:33.568 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install cephadm 2026-02-18T03:23:33.638 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:33.651 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:33.651 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:23:33.651 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:23:33.651 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:23:33.651 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:23:33.652 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:23:33.653 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:23:33.654 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:23:33.655 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:23:33.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:23:33.657 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:23:33.658 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:23:33.659 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:23:33.702 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:33.714 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:23:33.714 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:33.714 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.715 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:23:33.716 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:23:33.717 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:23:33.718 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:23:33.719 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:23:33.720 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:23:33.721 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:33.722 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:33.723 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:33.723 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:33.723 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:33.740 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados-devel 2026-02-18T03:23:33.768 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:33.785 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:33.812 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr 2026-02-18T03:23:33.877 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:33.941 INFO:teuthology.orchestra.run.trial177.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:33.958 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:33.959 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:33.959 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:33.980 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:23:34.049 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:34.064 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T03:23:34.069 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:34.079 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:34.125 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:34.130 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:23:34.131 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 126 k 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 449 k 2026-02-18T03:23:34.132 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:34.142 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:34.160 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:34.161 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:34.161 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:34.183 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-18T03:23:34.189 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:34.207 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:34.207 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:34.207 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:34.221 INFO:teuthology.orchestra.run.trial034.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-18T03:23:34.222 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:34.222 INFO:teuthology.orchestra.run.trial034.stdout:Total 1.3 MB/s | 126 kB 00:00 2026-02-18T03:23:34.222 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:34.225 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:34.225 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:34.228 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:23:34.255 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:34.256 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:34.291 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:34.310 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:34.326 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:34.373 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:34.373 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:34.373 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repo Size 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 154 k 2026-02-18T03:23:34.374 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 447 k 2026-02-18T03:23:34.375 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:34.406 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:34.458 INFO:teuthology.orchestra.run.trial177.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:34.459 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:34.459 INFO:teuthology.orchestra.run.trial177.stdout:Total 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:34.459 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:34.463 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:34.464 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:34.464 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:34.487 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:34.493 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs2 2026-02-18T03:23:34.496 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:34.496 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:34.521 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T03:23:34.522 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:34.535 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T03:23:34.535 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:34.536 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:34.550 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:34.551 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:34.553 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:34.568 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:34.569 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:34.569 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:34.576 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:34.576 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:34.576 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:23:34.576 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:34.589 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:23:34.593 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T03:23:34.601 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:34.618 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:34.619 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:34.620 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:34.637 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T03:23:34.638 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:34.640 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:23:34.660 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T03:23:34.660 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:34.660 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T03:23:34.661 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:34.661 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T03:23:34.661 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:34.673 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:34.802 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:34.866 INFO:teuthology.orchestra.run.trial034.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:34.884 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:34.884 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:34.884 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:34.885 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:34.891 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:34.896 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T03:23:34.897 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:34.905 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs-devel 2026-02-18T03:23:34.911 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-mgr 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T03:23:34.920 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:34.946 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:34.973 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:34.974 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:34.975 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 154 k 2026-02-18T03:23:34.976 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 447 k 2026-02-18T03:23:34.976 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:35.009 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:35.018 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:35.027 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:35.028 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:35.028 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:35.040 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T03:23:35.041 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:35.041 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T03:23:35.041 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:35.041 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T03:23:35.041 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:35.050 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:23:35.060 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:35.060 INFO:teuthology.orchestra.run.trial086.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T03:23:35.061 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:35.061 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-18T03:23:35.061 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:35.066 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:35.066 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:35.098 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:35.098 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:35.153 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:35.155 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:35.177 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:35.178 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:35.178 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:23:35.178 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:35.216 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:35.223 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:35.289 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:35.296 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:35.297 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:35.297 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 34 k 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 155 k 2026-02-18T03:23:35.298 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:35.307 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:35.308 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:35.308 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:35.329 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:23:35.359 INFO:teuthology.orchestra.run.trial034.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 559 kB/s | 34 kB 00:00 2026-02-18T03:23:35.360 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:35.360 INFO:teuthology.orchestra.run.trial034.stdout:Total 551 kB/s | 34 kB 00:00 2026-02-18T03:23:35.360 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:35.362 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:35.362 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:35.363 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:35.364 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:35.364 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:35.385 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:35.401 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:35.426 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:35.444 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:35.444 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:35.445 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:35.454 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:35.466 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:23:35.479 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:35.479 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:35.479 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:35.479 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.480 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:35.480 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:35.506 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-18T03:23:35.510 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:35.511 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:35.511 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:35.511 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.511 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:35.511 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:35.538 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados2 2026-02-18T03:23:35.636 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:35.700 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:35.717 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:35.718 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:35.718 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T03:23:35.735 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T03:23:35.736 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T03:23:35.737 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T03:23:35.738 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T03:23:35.739 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T03:23:35.740 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T03:23:35.741 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T03:23:35.742 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T03:23:35.744 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:23:35.776 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:35.796 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T03:23:35.796 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:35.796 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:35.796 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.797 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T03:23:35.798 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T03:23:35.799 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T03:23:35.800 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T03:23:35.801 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T03:23:35.802 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T03:23:35.803 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T03:23:35.804 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T03:23:35.805 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T03:23:35.805 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-18T03:23:35.805 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:35.805 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:35.811 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:35.840 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:35.847 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:35.853 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base 2026-02-18T03:23:35.857 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:35.858 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:35.858 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:35.875 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:35.878 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-fuse 2026-02-18T03:23:35.892 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:35.893 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:35.893 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:35.912 INFO:teuthology.orchestra.run.trial034.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:35.914 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:23:35.930 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:35.931 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:35.931 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:35.952 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librbd1 2026-02-18T03:23:36.052 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:36.116 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.133 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:36.134 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:36.134 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:36.155 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:23:36.167 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:36.188 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:36.218 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:36.230 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:36.248 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:36.249 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:36.249 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:36.265 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:36.269 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:36.271 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:36.272 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 942 k 2026-02-18T03:23:36.272 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 2.7 M 2026-02-18T03:23:36.272 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:36.272 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install cephadm 2026-02-18T03:23:36.281 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.299 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:36.299 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:36.299 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:36.321 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:23:36.330 INFO:teuthology.orchestra.run.trial034.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:36.348 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:36.349 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:36.349 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:36.370 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rados 2026-02-18T03:23:36.387 INFO:teuthology.orchestra.run.trial014.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.8 MB/s | 942 kB 00:00 2026-02-18T03:23:36.388 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:36.388 INFO:teuthology.orchestra.run.trial014.stdout:Total 7.8 MB/s | 942 kB 00:00 2026-02-18T03:23:36.388 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:36.393 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:36.393 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:36.426 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:36.426 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:36.461 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:36.516 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:36.525 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.533 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:36.543 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:36.543 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:36.544 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:36.564 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:23:36.581 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:36.624 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:36.645 INFO:teuthology.orchestra.run.trial155.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.662 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:36.663 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:36.663 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:36.675 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:36.685 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T03:23:36.687 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.705 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:36.705 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:36.705 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:36.725 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:23:36.740 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:36.746 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:36.757 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:36.758 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:36.758 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:36.779 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rgw 2026-02-18T03:23:36.802 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:36.802 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:36.802 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:36.803 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:36.803 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:36.803 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:36.831 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-volume 2026-02-18T03:23:36.878 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:36.943 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:36.961 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:36.962 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:36.962 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:36.983 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-fuse 2026-02-18T03:23:36.987 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:37.028 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:37.068 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:37.069 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:37.069 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-18T03:23:37.069 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 154 k 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 447 k 2026-02-18T03:23:37.070 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:37.087 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:37.092 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:37.110 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:37.110 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:37.111 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:37.131 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:23:37.141 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:37.151 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:37.169 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:37.170 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:37.170 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:37.191 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-cephfs 2026-02-18T03:23:37.206 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:37.224 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:37.225 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:37.225 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:37.246 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados-devel 2026-02-18T03:23:37.298 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:37.380 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:37.380 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:37.381 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:37.382 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:37.382 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 942 k 2026-02-18T03:23:37.382 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 2.7 M 2026-02-18T03:23:37.382 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:37.445 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:37.498 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 359 kB/s | 154 kB 00:00 2026-02-18T03:23:37.498 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:37.498 INFO:teuthology.orchestra.run.trial155.stdout:Total 358 kB/s | 154 kB 00:00 2026-02-18T03:23:37.498 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:37.502 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:37.504 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:37.504 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:37.508 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:37.526 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:37.527 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:37.527 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:37.536 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:37.536 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:37.547 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-18T03:23:37.553 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:37.565 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:37.583 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:37.583 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:37.583 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:37.591 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:37.592 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:37.604 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rbd 2026-02-18T03:23:37.615 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:37.615 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:37.615 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T03:23:37.615 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:37.634 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:37.635 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 126 k 2026-02-18T03:23:37.635 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 449 k 2026-02-18T03:23:37.635 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:37.788 INFO:teuthology.orchestra.run.trial014.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 824 kB/s | 126 kB 00:00 2026-02-18T03:23:37.788 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:37.788 INFO:teuthology.orchestra.run.trial014.stdout:Total 818 kB/s | 126 kB 00:00 2026-02-18T03:23:37.788 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:37.791 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:37.791 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:37.823 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:37.823 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:37.826 INFO:teuthology.orchestra.run.trial177.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 942 kB 00:00 2026-02-18T03:23:37.827 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:37.827 INFO:teuthology.orchestra.run.trial177.stdout:Total 2.1 MB/s | 942 kB 00:00 2026-02-18T03:23:37.827 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:37.832 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:37.832 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:37.853 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:37.866 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:37.866 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:37.877 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:37.893 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:37.903 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:37.907 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:37.929 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr 2026-02-18T03:23:37.935 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:37.936 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:37.937 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:37.937 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:37.937 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 942 k 2026-02-18T03:23:37.937 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.7 M 2026-02-18T03:23:37.937 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:37.956 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:37.971 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:37.973 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:37.974 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:37.989 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:37.989 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-18T03:23:37.990 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:38.010 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-fuse 2026-02-18T03:23:38.030 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.030 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:38.031 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:38.031 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:38.031 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:38.031 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:38.056 INFO:teuthology.orchestra.run.trial086.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.7 MB/s | 942 kB 00:00 2026-02-18T03:23:38.057 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:38.057 INFO:teuthology.orchestra.run.trial086.stdout:Total 7.6 MB/s | 942 kB 00:00 2026-02-18T03:23:38.057 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:38.058 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install libcephfs2 2026-02-18T03:23:38.062 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:38.062 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:38.095 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:38.095 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:38.184 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:38.201 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.209 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.240 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:38.265 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:38.293 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-volume 2026-02-18T03:23:38.306 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:38.321 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:38.324 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:38.325 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:38.325 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:38.346 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T03:23:38.374 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:38.404 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:23:38.405 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 91 k 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 238 k 2026-02-18T03:23:38.406 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:38.439 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.442 INFO:teuthology.orchestra.run.trial014.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:38.460 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:38.461 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:38.461 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:38.478 INFO:teuthology.orchestra.run.trial034.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:38.478 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:38.479 INFO:teuthology.orchestra.run.trial034.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:38.479 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:38.483 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install libcephfs-devel 2026-02-18T03:23:38.484 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:38.484 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:38.497 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:38.513 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:38.513 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:38.524 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-18T03:23:38.564 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:38.581 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.613 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:38.658 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.660 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:38.677 INFO:teuthology.orchestra.run.trial177.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:38.695 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:38.696 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:38.696 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:38.718 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install librados-devel 2026-02-18T03:23:38.719 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:38.719 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:38.719 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:38.719 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:38.719 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:38.720 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:38.724 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:38.742 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:38.742 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:38.742 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:38.746 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-mirror 2026-02-18T03:23:38.764 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T03:23:38.811 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:38.834 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:38.893 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:38.894 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:38.894 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 34 k 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 155 k 2026-02-18T03:23:38.895 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:38.898 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:38.917 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:38.917 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:38.918 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:38.939 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-18T03:23:38.979 INFO:teuthology.orchestra.run.trial014.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 406 kB/s | 34 kB 00:00 2026-02-18T03:23:38.980 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:38.980 INFO:teuthology.orchestra.run.trial014.stdout:Total 402 kB/s | 34 kB 00:00 2026-02-18T03:23:38.980 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:38.982 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:38.983 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:38.985 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:38.985 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:39.006 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:39.021 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.032 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:39.060 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:39.075 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:39.076 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.113 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:39.113 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repo Size 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:39.114 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 126 k 2026-02-18T03:23:39.115 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 449 k 2026-02-18T03:23:39.115 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:39.131 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.131 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:39.131 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:39.132 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:39.132 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:39.132 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:39.138 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:39.142 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:39.143 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 2.9 M 2026-02-18T03:23:39.144 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 11 M 2026-02-18T03:23:39.144 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:39.156 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:39.157 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:39.157 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:39.158 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados2 2026-02-18T03:23:39.179 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-rook 2026-02-18T03:23:39.248 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:39.323 INFO:teuthology.orchestra.run.trial177.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 601 kB/s | 126 kB 00:00 2026-02-18T03:23:39.324 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:39.324 INFO:teuthology.orchestra.run.trial177.stdout:Total 598 kB/s | 126 kB 00:00 2026-02-18T03:23:39.324 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:39.327 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:39.327 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 126 k 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 449 k 2026-02-18T03:23:39.329 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:39.358 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:39.358 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:39.413 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:39.429 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.469 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:39.481 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:39.515 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.535 INFO:teuthology.orchestra.run.trial014.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:39.545 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:39.553 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:39.553 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:39.553 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:39.563 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:39.563 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:39.564 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:39.573 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:39.575 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librbd1 2026-02-18T03:23:39.584 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T03:23:39.602 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install libcephfs2 2026-02-18T03:23:39.688 INFO:teuthology.orchestra.run.trial086.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 351 kB/s | 126 kB 00:00 2026-02-18T03:23:39.689 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:39.690 INFO:teuthology.orchestra.run.trial086.stdout:Total 349 kB/s | 126 kB 00:00 2026-02-18T03:23:39.690 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:39.693 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:39.693 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:39.724 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:39.724 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:39.779 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:39.795 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.874 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.886 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:39.896 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:39.911 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:39.931 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:39.950 INFO:teuthology.orchestra.run.trial014.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:39.959 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-18T03:23:39.959 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:39.968 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:39.969 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:39.969 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:39.977 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:39.977 INFO:teuthology.orchestra.run.trial177.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:39.977 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:39.978 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:39.989 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rados 2026-02-18T03:23:39.995 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:39.995 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:39.996 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:39.999 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse 2026-02-18T03:23:40.017 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install libcephfs-devel 2026-02-18T03:23:40.266 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:40.299 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:40.307 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:40.322 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:40.330 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:40.348 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:40.348 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:40.348 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:40.363 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:40.369 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-18T03:23:40.381 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:40.381 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:40.382 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:40.388 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:40.389 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:40.389 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:40.389 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 942 k 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 2.7 M 2026-02-18T03:23:40.390 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repo Size 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:40.404 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:40.405 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:40.405 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:40.405 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 34 k 2026-02-18T03:23:40.405 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 155 k 2026-02-18T03:23:40.405 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:40.405 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rgw 2026-02-18T03:23:40.633 INFO:teuthology.orchestra.run.trial177.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 149 kB/s | 34 kB 00:00 2026-02-18T03:23:40.634 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:40.634 INFO:teuthology.orchestra.run.trial177.stdout:Total 149 kB/s | 34 kB 00:00 2026-02-18T03:23:40.634 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:40.637 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:40.637 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:40.639 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:40.639 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:40.662 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:40.672 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:40.679 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:40.713 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:40.723 INFO:teuthology.orchestra.run.trial034.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 1.8 MB/s | 2.9 MB 00:01 2026-02-18T03:23:40.723 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:40.724 INFO:teuthology.orchestra.run.trial034.stdout:Total 1.8 MB/s | 2.9 MB 00:01 2026-02-18T03:23:40.724 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:40.729 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:40.729 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:40.734 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:40.754 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:40.755 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:40.755 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-18T03:23:40.755 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:40.755 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 34 k 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 155 k 2026-02-18T03:23:40.756 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:40.768 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:40.768 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:40.776 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:40.792 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:40.794 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:40.795 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:40.795 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:40.817 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-cephfs 2026-02-18T03:23:40.820 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install librados2 2026-02-18T03:23:40.947 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:40.948 INFO:teuthology.orchestra.run.trial086.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 178 kB/s | 34 kB 00:00 2026-02-18T03:23:40.949 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:40.950 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:40.950 INFO:teuthology.orchestra.run.trial086.stdout:Total 176 kB/s | 34 kB 00:00 2026-02-18T03:23:40.950 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:40.952 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:40.953 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:40.955 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:40.955 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:40.972 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:40.973 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:40.973 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:23:40.973 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:40.973 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:40.973 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:40.977 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:40.986 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.5 MB/s | 942 kB 00:00 2026-02-18T03:23:40.987 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:40.987 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.5 MB/s | 942 kB 00:00 2026-02-18T03:23:40.987 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:40.993 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.025 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:41.025 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:41.047 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:41.103 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:41.116 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:41.130 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-18T03:23:41.132 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:41.132 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:41.134 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.195 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.195 INFO:teuthology.orchestra.run.trial177.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.212 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:41.213 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:41.213 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:41.213 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:41.213 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:41.213 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:41.235 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rbd 2026-02-18T03:23:41.237 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install librbd1 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:41.268 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:41.295 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-nbd 2026-02-18T03:23:41.349 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.405 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:41.405 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:41.405 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:41.405 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:41.406 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:41.406 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:41.434 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-volume 2026-02-18T03:23:41.442 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:41.505 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.523 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:41.523 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:41.523 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:41.542 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:41.544 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-18T03:23:41.548 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:41.599 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:41.606 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.611 INFO:teuthology.orchestra.run.trial177.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.623 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:41.624 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-18T03:23:41.624 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:41.629 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:41.630 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:41.630 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:41.645 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-fuse 2026-02-18T03:23:41.651 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install python3-rados 2026-02-18T03:23:41.679 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 180 k 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 498 k 2026-02-18T03:23:41.680 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:41.745 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:41.810 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T03:23:41.828 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:41.829 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:41.829 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:41.851 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel 2026-02-18T03:23:41.854 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:41.917 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:41.935 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:41.936 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:41.936 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:41.955 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:41.957 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-18T03:23:41.960 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:42.012 INFO:teuthology.orchestra.run.trial034.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 543 kB/s | 180 kB 00:00 2026-02-18T03:23:42.014 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:42.014 INFO:teuthology.orchestra.run.trial034.stdout:Total 539 kB/s | 180 kB 00:00 2026-02-18T03:23:42.014 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:42.019 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:42.019 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:42.024 INFO:teuthology.orchestra.run.trial177.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:42.037 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:42.037 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.037 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 91 k 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 238 k 2026-02-18T03:23:42.038 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:42.042 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:42.042 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:42.043 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:42.050 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:42.050 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:42.064 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install python3-rgw 2026-02-18T03:23:42.107 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:42.124 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.162 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:42.201 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.238 INFO:teuthology.orchestra.run.trial014.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 454 kB/s | 91 kB 00:00 2026-02-18T03:23:42.239 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:42.239 INFO:teuthology.orchestra.run.trial014.stdout:Total 452 kB/s | 91 kB 00:00 2026-02-18T03:23:42.239 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:42.243 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:42.244 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:42.244 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:42.245 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:42.246 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:42.246 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 126 k 2026-02-18T03:23:42.246 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 449 k 2026-02-18T03:23:42.246 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:42.259 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:42.260 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:42.274 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:42.274 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:42.287 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install nvme-cli 2026-02-18T03:23:42.325 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:42.326 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:42.342 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.343 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:42.343 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:42.343 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:42.365 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-18T03:23:42.371 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:42.423 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.434 INFO:teuthology.orchestra.run.trial177.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:42.451 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:42.452 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:42.452 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:42.472 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install python3-cephfs 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.480 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:42.507 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-mirror 2026-02-18T03:23:42.576 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 380 kB/s | 126 kB 00:00 2026-02-18T03:23:42.577 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:42.578 INFO:teuthology.orchestra.run.trial155.stdout:Total 377 kB/s | 126 kB 00:00 2026-02-18T03:23:42.578 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:42.581 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:42.581 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:42.606 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:48 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:42.612 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:42.613 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:42.667 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:42.669 INFO:teuthology.orchestra.run.trial034.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:23:42.670 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:42.683 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.687 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout:Upgrading: 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:23:42.688 INFO:teuthology.orchestra.run.trial034.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout:Upgrade 2 Packages 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 1.3 M 2026-02-18T03:23:42.689 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-18T03:23:42.734 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:42.752 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:42.753 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:42.753 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:42.761 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.774 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-18T03:23:42.780 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:42.817 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:42.819 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:42.843 INFO:teuthology.orchestra.run.trial177.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:42.846 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2 2026-02-18T03:23:42.861 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:42.861 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:42.861 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:42.882 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install python3-rbd 2026-02-18T03:23:42.901 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:42.902 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:42.903 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:42.903 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:42.903 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 2.9 M 2026-02-18T03:23:42.903 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 11 M 2026-02-18T03:23:42.903 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:43.015 INFO:teuthology.orchestra.run.trial034.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 1.7 MB/s | 116 kB 00:00 2026-02-18T03:23:43.032 INFO:teuthology.orchestra.run.trial034.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2026-02-18T03:23:43.033 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:43.033 INFO:teuthology.orchestra.run.trial034.stdout:Total 3.7 MB/s | 1.3 MB 00:00 2026-02-18T03:23:43.051 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-18T03:23:43.057 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-18T03:23:43.057 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-18T03:23:43.085 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:43.101 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-18T03:23:43.101 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-18T03:23:43.117 INFO:teuthology.orchestra.run.trial014.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 14 MB/s | 2.9 MB 00:00 2026-02-18T03:23:43.118 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:43.118 INFO:teuthology.orchestra.run.trial014.stdout:Total 13 MB/s | 2.9 MB 00:00 2026-02-18T03:23:43.118 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:43.123 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:43.123 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:43.148 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:43.162 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:43.162 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:43.163 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-18T03:23:43.165 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:43.166 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:43.166 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:43.173 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:43.187 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-18T03:23:43.189 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:43.237 INFO:teuthology.orchestra.run.trial155.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:43.253 INFO:teuthology.orchestra.run.trial177.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:43.255 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:43.255 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:43.255 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:43.271 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:43.272 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-18T03:23:43.272 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:43.277 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs-devel 2026-02-18T03:23:43.283 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:43.286 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:43.292 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install rbd-fuse 2026-02-18T03:23:43.347 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:43.349 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:43.372 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:43.469 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:43.473 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:23:43.493 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:43.496 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:43.556 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:43.574 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:43.574 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-18T03:23:43.574 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:43.591 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:43.595 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-18T03:23:43.601 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:43.659 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.660 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:43.660 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:43.660 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:43.660 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:43.660 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:43.674 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:43.674 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:43.675 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 34 k 2026-02-18T03:23:43.676 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 155 k 2026-02-18T03:23:43.676 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:43.683 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:43.684 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:43.685 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:43.685 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:43.685 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 91 k 2026-02-18T03:23:43.685 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 238 k 2026-02-18T03:23:43.685 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:43.689 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-nbd 2026-02-18T03:23:43.737 INFO:teuthology.orchestra.run.trial155.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 552 kB/s | 34 kB 00:00 2026-02-18T03:23:43.738 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:43.738 INFO:teuthology.orchestra.run.trial155.stdout:Total 544 kB/s | 34 kB 00:00 2026-02-18T03:23:43.738 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:43.740 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:43.740 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:43.742 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:43.742 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:43.744 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:43.744 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:43.744 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:23:43.744 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:23:43.756 INFO:teuthology.orchestra.run.trial177.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:43.756 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:43.756 INFO:teuthology.orchestra.run.trial177.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:43.756 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:43.760 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:43.761 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:43.763 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:43.779 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.791 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:43.791 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:43.801 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:23:43.801 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:43.802 INFO:teuthology.orchestra.run.trial034.stdout:Upgraded: 2026-02-18T03:23:43.802 INFO:teuthology.orchestra.run.trial034.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:23:43.802 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:23:43.802 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-18T03:23:43.832 DEBUG:teuthology.parallel:result is None 2026-02-18T03:23:43.833 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.845 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:43.861 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:43.891 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:43.904 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:43.919 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2 2026-02-18T03:23:43.942 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.986 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:43.987 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:43.987 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:43.987 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 91 k 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 238 k 2026-02-18T03:23:43.988 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:43.999 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:43.999 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:44.000 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:44.000 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:44.000 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:44.000 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:44.003 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:44.026 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install rbd-mirror 2026-02-18T03:23:44.060 INFO:teuthology.orchestra.run.trial086.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:44.061 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:44.061 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:44.061 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:44.065 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:44.065 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 180 k 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 498 k 2026-02-18T03:23:44.087 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:44.095 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:44.095 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:44.149 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:44.165 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.171 INFO:teuthology.orchestra.run.trial014.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:44.172 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:44.173 INFO:teuthology.orchestra.run.trial014.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:44.173 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:44.177 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:44.177 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:44.209 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:44.209 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:44.225 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:44.242 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.265 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:44.282 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.289 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:44.300 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:44.306 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:44.307 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:44.307 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:44.327 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-18T03:23:44.329 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1 2026-02-18T03:23:44.345 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:44.368 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.425 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.425 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.425 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-18T03:23:44.425 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:44.425 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.426 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:44.428 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repo Size 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:23:44.429 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 2.9 M 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 11 M 2026-02-18T03:23:44.430 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:44.453 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install nvme-cli 2026-02-18T03:23:44.635 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:44.640 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:44.643 INFO:teuthology.orchestra.run.trial177.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 14 MB/s | 2.9 MB 00:00 2026-02-18T03:23:44.643 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:44.643 INFO:teuthology.orchestra.run.trial177.stdout:Total 14 MB/s | 2.9 MB 00:00 2026-02-18T03:23:44.643 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:44.647 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:44.648 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:44.686 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:44.687 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:44.699 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:44.717 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:44.718 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:44.718 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:44.722 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:44.723 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:44.724 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:44.724 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 2.9 M 2026-02-18T03:23:44.724 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 11 M 2026-02-18T03:23:44.724 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:44.739 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados 2026-02-18T03:23:44.765 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:23:44.831 INFO:teuthology.orchestra.run.trial014.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:23:44.849 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-18T03:23:44.850 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.850 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:Upgrading: 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:Upgrade 2 Packages 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 1.3 M 2026-02-18T03:23:44.851 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-18T03:23:44.868 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:44.869 INFO:teuthology.orchestra.run.trial086.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T03:23:44.870 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:44.870 INFO:teuthology.orchestra.run.trial086.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T03:23:44.870 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:44.870 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.875 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:44.875 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:44.892 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:44.892 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:44.892 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:23:44.892 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:44.892 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:44.893 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:44.914 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:44.914 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:45.043 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:45.096 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:45.098 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.112 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:45.121 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.121 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:45.121 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:23:45.122 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:45.122 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:45.122 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:45.130 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:45.131 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:45.131 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:45.152 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw 2026-02-18T03:23:45.178 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.179 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.179 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:45.179 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:45.179 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.179 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:45.206 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install rbd-nbd 2026-02-18T03:23:45.438 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.438 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:45.438 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:45.438 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:45.439 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:45.439 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:45.461 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:45.469 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-18T03:23:45.516 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:45.526 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:45.544 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:45.545 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:45.545 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:45.567 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs 2026-02-18T03:23:45.597 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:45.598 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:45.598 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:45.598 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:45.598 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:Install 1 Package 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 180 k 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 498 k 2026-02-18T03:23:45.599 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:45.683 INFO:teuthology.orchestra.run.trial177.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:45.684 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:45.684 INFO:teuthology.orchestra.run.trial177.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-18T03:23:45.684 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:45.689 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:45.689 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:45.720 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:45.720 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:45.776 INFO:teuthology.orchestra.run.trial014.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 193 kB/s | 116 kB 00:00 2026-02-18T03:23:45.776 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:45.779 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:45.793 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.863 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:45.864 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 180 k 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 498 k 2026-02-18T03:23:45.865 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:45.873 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.880 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:45.937 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:45.937 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.937 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-18T03:23:45.937 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:45.937 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:45.938 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:45.946 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:45.949 INFO:teuthology.orchestra.run.trial086.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:45.950 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:45.951 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-18T03:23:45.951 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:45.955 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:45.955 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:45.963 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:45.964 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:45.964 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:45.967 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install nvme-cli 2026-02-18T03:23:45.985 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd 2026-02-18T03:23:45.986 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:45.986 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:46.024 INFO:teuthology.orchestra.run.trial014.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2026-02-18T03:23:46.025 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:46.025 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.1 MB/s | 1.3 MB 00:01 2026-02-18T03:23:46.042 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:46.044 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-18T03:23:46.050 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-18T03:23:46.051 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-18T03:23:46.059 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:46.092 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-18T03:23:46.092 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-18T03:23:46.141 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:46.154 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:46.199 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:46.228 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install nvme-cli 2026-02-18T03:23:46.275 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:46.278 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:46.281 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Feb 2026 03:22:49 AM UTC. 2026-02-18T03:23:46.293 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:46.345 INFO:teuthology.orchestra.run.trial177.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:23:46.357 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T03:23:46.363 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout:Upgrading: 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:23:46.364 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout:Upgrade 2 Packages 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 1.3 M 2026-02-18T03:23:46.365 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-18T03:23:46.375 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:46.376 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-18T03:23:46.376 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:46.397 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse 2026-02-18T03:23:46.452 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:46.457 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:23:46.478 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:46.543 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Feb 2026 03:22:59 AM UTC. 2026-02-18T03:23:46.606 INFO:teuthology.orchestra.run.trial086.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:23:46.624 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout:Upgrading: 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:46.625 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-18T03:23:46.626 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-18T03:23:46.626 INFO:teuthology.orchestra.run.trial086.stdout:Upgrade 2 Packages 2026-02-18T03:23:46.626 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:46.626 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 1.3 M 2026-02-18T03:23:46.626 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-18T03:23:46.708 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:46.712 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:46.712 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:46.712 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:23:46.712 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:23:46.721 INFO:teuthology.orchestra.run.trial086.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 2.9 MB/s | 116 kB 00:00 2026-02-18T03:23:46.755 INFO:teuthology.orchestra.run.trial086.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2026-02-18T03:23:46.755 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:46.755 INFO:teuthology.orchestra.run.trial086.stdout:Total 9.7 MB/s | 1.3 MB 00:00 2026-02-18T03:23:46.768 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:23:46.769 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:46.769 INFO:teuthology.orchestra.run.trial014.stdout:Upgraded: 2026-02-18T03:23:46.769 INFO:teuthology.orchestra.run.trial014.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:23:46.769 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-18T03:23:46.769 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-18T03:23:46.773 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-18T03:23:46.780 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-18T03:23:46.781 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-18T03:23:46.790 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T03:23:46.791 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 91 k 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 238 k 2026-02-18T03:23:46.792 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:46.803 DEBUG:teuthology.parallel:result is None 2026-02-18T03:23:46.823 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-18T03:23:46.824 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-18T03:23:46.865 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:46.866 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:46.866 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-18T03:23:46.866 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:46.870 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:46.870 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:46.888 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-18T03:23:46.901 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:46.902 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:46.952 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:46.970 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:47.008 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:47.011 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:47.047 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:47.104 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:47.104 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:47.104 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:47.104 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:47.105 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:47.105 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:47.132 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror 2026-02-18T03:23:47.160 INFO:teuthology.orchestra.run.trial177.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 163 kB/s | 116 kB 00:00 2026-02-18T03:23:47.195 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:47.199 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:23:47.223 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:47.394 INFO:teuthology.orchestra.run.trial177.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-18T03:23:47.395 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:47.395 INFO:teuthology.orchestra.run.trial177.stdout:Total 1.2 MB/s | 1.3 MB 00:01 2026-02-18T03:23:47.416 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-18T03:23:47.422 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-18T03:23:47.422 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-18T03:23:47.450 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:47.465 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-18T03:23:47.465 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-18T03:23:47.469 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:47.469 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:47.469 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:23:47.469 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:23:47.527 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:23:47.527 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:47.527 INFO:teuthology.orchestra.run.trial086.stdout:Upgraded: 2026-02-18T03:23:47.527 INFO:teuthology.orchestra.run.trial086.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:23:47.527 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:23:47.528 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-18T03:23:47.528 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-18T03:23:47.533 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:47.533 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:47.533 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 2.9 M 2026-02-18T03:23:47.534 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 11 M 2026-02-18T03:23:47.535 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:47.563 DEBUG:teuthology.parallel:result is None 2026-02-18T03:23:47.648 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:47.650 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:47.680 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T03:23:47.680 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:47.680 INFO:teuthology.orchestra.run.trial155.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T03:23:47.680 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:47.685 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:47.685 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:47.724 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:47.724 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:47.829 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:47.832 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:23:47.854 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:47.906 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:47.908 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:47.930 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:47.930 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T03:23:47.930 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T03:23:47.930 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:47.930 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T03:23:47.931 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.092 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:48.092 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:48.092 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:23:48.092 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout:Upgraded: 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:23:48.150 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-18T03:23:48.184 DEBUG:teuthology.parallel:result is None 2026-02-18T03:23:48.206 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:48.206 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.206 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:48.206 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:48.207 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.207 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:48.234 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd 2026-02-18T03:23:48.548 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:48.631 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:48.631 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:48.631 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:48.632 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:48.633 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-18T03:23:48.633 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.633 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 180 k 2026-02-18T03:23:48.633 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 498 k 2026-02-18T03:23:48.633 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:48.715 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:48.716 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:48.716 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T03:23:48.716 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:48.720 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:48.721 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:48.752 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:48.752 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:48.808 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:48.825 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:48.904 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:48.961 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T03:23:48.962 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.962 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-18T03:23:48.962 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T03:23:48.962 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:48.962 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:48.990 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install nvme-cli 2026-02-18T03:23:49.308 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Feb 2026 03:22:54 AM UTC. 2026-02-18T03:23:49.372 INFO:teuthology.orchestra.run.trial155.stdout:Package nvme-cli-2.13-1.el9.x86_64 is already installed. 2026-02-18T03:23:49.391 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-18T03:23:49.391 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:49.391 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.3 M 2026-02-18T03:23:49.392 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-18T03:23:49.621 INFO:teuthology.orchestra.run.trial155.stdout:(1/2): libnvme-1.16.1-2.el9.x86_64.rpm 826 kB/s | 116 kB 00:00 2026-02-18T03:23:49.666 INFO:teuthology.orchestra.run.trial155.stdout:(2/2): nvme-cli-2.16-1.el9.x86_64.rpm 6.2 MB/s | 1.2 MB 00:00 2026-02-18T03:23:49.666 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:23:49.667 INFO:teuthology.orchestra.run.trial155.stdout:Total 4.6 MB/s | 1.3 MB 00:00 2026-02-18T03:23:49.685 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-18T03:23:49.691 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-18T03:23:49.692 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-18T03:23:49.734 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-18T03:23:49.734 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-18T03:23:49.796 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-18T03:23:49.914 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:49.916 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:50.092 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:23:50.096 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : nvme-cli-2.13-1.el9.x86_64 3/4 2026-02-18T03:23:50.118 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:50.363 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 4/4 2026-02-18T03:23:50.363 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 1/4 2026-02-18T03:23:50.363 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnvme-1.13-1.el9.x86_64 2/4 2026-02-18T03:23:50.364 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 4/4 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout: libnvme-1.16.1-2.el9.x86_64 nvme-cli-2.16-1.el9.x86_64 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:23:50.420 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-18T03:23:50.451 DEBUG:teuthology.parallel:result is None 2026-02-18T03:23:50.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:50.601 DEBUG:teuthology.orchestra.run.trial014:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:23:50.623 INFO:teuthology.orchestra.run.trial014.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.624 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.624 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:23:50.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:50.772 DEBUG:teuthology.orchestra.run.trial034:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:23:50.793 INFO:teuthology.orchestra.run.trial034.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.793 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.793 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:23:50.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:50.926 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:23:50.948 INFO:teuthology.orchestra.run.trial086.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.948 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:23:50.948 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:23:50.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:51.086 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:23:51.107 INFO:teuthology.orchestra.run.trial155.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:23:51.108 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:23:51.108 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:23:51.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:51.246 DEBUG:teuthology.orchestra.run.trial177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T03:23:51.267 INFO:teuthology.orchestra.run.trial177.stdout:20.2.0-670.gadc19233.el9 2026-02-18T03:23:51.267 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T03:23:51.267 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T03:23:51.269 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T03:23:51.269 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:23:51.269 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:23:51.297 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:23:51.297 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:23:51.324 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:23:51.324 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:23:51.352 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:23:51.352 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:23:51.380 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:23:51.380 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T03:23:51.406 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T03:23:51.406 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:23:51.406 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:23:51.432 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:23:51.497 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:23:51.497 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:23:51.522 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:23:51.589 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:23:51.589 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:23:51.615 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:23:51.680 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:23:51.680 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:23:51.707 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:23:51.771 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:23:51.771 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T03:23:51.797 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T03:23:51.860 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T03:23:51.860 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:23:51.861 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:23:51.885 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:23:51.948 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:23:51.948 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:23:51.974 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:23:52.040 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:23:52.040 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:23:52.066 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:23:52.129 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:23:52.129 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:23:52.155 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:23:52.219 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:23:52.219 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T03:23:52.243 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T03:23:52.306 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T03:23:52.306 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:23:52.306 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:23:52.332 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:23:52.397 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:23:52.397 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:23:52.424 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:23:52.487 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:23:52.487 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:23:52.512 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:23:52.578 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:23:52.578 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:23:52.604 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:23:52.668 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:23:52.668 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T03:23:52.694 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T03:23:52.756 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-18T03:23:52.888 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'OSD_DOWN', 'OSD_HOST_DOWN', 'OSD_ROOT_DOWN', 'osds down', 'PG_DEGRADED', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum', 'CEPHADM_FAILED_DAEMON', 'NVMEOF_SINGLE_GATEWAY', 'NVMEOF_GATEWAY_DOWN', 'are in unavailable state', 'is unavailable', 'is in error state', 'failed cephadm daemon', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_DAEMON_PLACE_FAIL'], 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T03:23:52.888 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:52.892 INFO:tasks.cephadm:Cluster fsid is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:23:52.892 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-18T03:23:52.892 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.34', 'mon.b': '10.20.193.86', 'mon.c': '10.20.193.155'} 2026-02-18T03:23:52.892 INFO:tasks.cephadm:First mon is mon.a on trial034 2026-02-18T03:23:52.892 INFO:tasks.cephadm:First mgr is x 2026-02-18T03:23:52.892 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-18T03:23:52.893 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname $(hostname -s) 2026-02-18T03:23:52.919 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname $(hostname -s) 2026-02-18T03:23:52.944 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname $(hostname -s) 2026-02-18T03:23:52.969 DEBUG:teuthology.orchestra.run.trial155:> sudo hostname $(hostname -s) 2026-02-18T03:23:52.995 DEBUG:teuthology.orchestra.run.trial177:> sudo hostname $(hostname -s) 2026-02-18T03:23:53.020 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-18T03:23:53.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:53.182 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/', 'ref': '20.2.1_2.17.26-baseline_2', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-17 18:19:08.791671', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.2.0-670-gadc19233', 'package_manager_version': '20.2.0-670.gadc19233', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3038/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-18T03:23:53.325 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref 20.2.1_2.17.26-baseline_2, sha1 adc1923395f2bcd6ae89b5d331d278364d1848ed from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:23:53.326 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm 2026-02-18T03:23:53.326 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm 2026-02-18T03:23:53.326 DEBUG:teuthology.orchestra.run.trial014:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:54.077 INFO:teuthology.orchestra.run.trial014.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:23 /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:54.078 DEBUG:teuthology.orchestra.run.trial034:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:54.523 INFO:teuthology.orchestra.run.trial034.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:23 /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:54.523 DEBUG:teuthology.orchestra.run.trial086:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:55.276 INFO:teuthology.orchestra.run.trial086.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:23 /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:55.277 DEBUG:teuthology.orchestra.run.trial155:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.018 INFO:teuthology.orchestra.run.trial155.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:23 /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.018 DEBUG:teuthology.orchestra.run.trial177:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.290 INFO:teuthology.orchestra.run.trial177.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054179 Feb 18 03:23 /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.291 DEBUG:teuthology.orchestra.run.trial014:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.310 DEBUG:teuthology.orchestra.run.trial034:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.330 DEBUG:teuthology.orchestra.run.trial086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.348 DEBUG:teuthology.orchestra.run.trial155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.367 DEBUG:teuthology.orchestra.run.trial177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-18T03:23:58.410 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed on all hosts... 2026-02-18T03:23:58.410 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:23:58.413 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:23:58.415 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:23:58.418 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:23:58.420 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed pull 2026-02-18T03:23:58.564 INFO:teuthology.orchestra.run.trial014.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:23:58.567 INFO:teuthology.orchestra.run.trial086.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:23:58.572 INFO:teuthology.orchestra.run.trial034.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:23:58.574 INFO:teuthology.orchestra.run.trial155.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:23:58.582 INFO:teuthology.orchestra.run.trial177.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:24:06.912 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-18T03:24:06.912 INFO:teuthology.orchestra.run.trial155.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:24:06.912 INFO:teuthology.orchestra.run.trial155.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:24:06.912 INFO:teuthology.orchestra.run.trial155.stdout: "repo_digests": [ 2026-02-18T03:24:06.912 INFO:teuthology.orchestra.run.trial155.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:24:06.913 INFO:teuthology.orchestra.run.trial155.stdout: ] 2026-02-18T03:24:06.913 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout: "repo_digests": [ 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:24:06.914 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:24:06.915 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout: "repo_digests": [ 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout: ] 2026-02-18T03:24:06.916 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-18T03:24:06.931 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:24:06.931 INFO:teuthology.orchestra.run.trial034.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:24:06.931 INFO:teuthology.orchestra.run.trial034.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:24:06.931 INFO:teuthology.orchestra.run.trial034.stdout: "repo_digests": [ 2026-02-18T03:24:06.931 INFO:teuthology.orchestra.run.trial034.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:24:06.932 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:24:06.932 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:24:06.953 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable)", 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout: "image_id": "c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc", 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout: "repo_digests": [ 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c" 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout: ] 2026-02-18T03:24:06.954 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-18T03:24:06.970 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /etc/ceph 2026-02-18T03:24:07.048 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /etc/ceph 2026-02-18T03:24:07.074 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /etc/ceph 2026-02-18T03:24:07.103 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /etc/ceph 2026-02-18T03:24:07.130 DEBUG:teuthology.orchestra.run.trial177:> sudo mkdir -p /etc/ceph 2026-02-18T03:24:07.157 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 777 /etc/ceph 2026-02-18T03:24:07.183 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod 777 /etc/ceph 2026-02-18T03:24:07.208 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 777 /etc/ceph 2026-02-18T03:24:07.234 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 777 /etc/ceph 2026-02-18T03:24:07.259 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 777 /etc/ceph 2026-02-18T03:24:07.285 INFO:tasks.cephadm:Writing seed config... 2026-02-18T03:24:07.288 INFO:tasks.cephadm: override: [global] mon warn on pool no app = False 2026-02-18T03:24:07.288 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-18T03:24:07.288 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-18T03:24:07.288 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-18T03:24:07.288 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-18T03:24:07.289 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-18T03:24:07.289 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-18T03:24:07.289 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-18T03:24:07.289 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-18T03:24:07.290 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:07.290 DEBUG:teuthology.orchestra.run.trial034:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-18T03:24:07.308 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3ff67590-0c79-11f1-9051-d404e6e7d460 mon warn on pool no app = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-18T03:24:07.308 DEBUG:teuthology.orchestra.run.trial034:mon.a> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service 2026-02-18T03:24:07.351 DEBUG:teuthology.orchestra.run.trial034:mgr.x> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service 2026-02-18T03:24:07.393 INFO:tasks.cephadm:Bootstrapping... 2026-02-18T03:24:07.393 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed -v bootstrap --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.34 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:07.533 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:24:07.533 INFO:teuthology.orchestra.run.trial034.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed', '-v', 'bootstrap', '--fsid', '3ff67590-0c79-11f1-9051-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.34', '--skip-admin-label'] 2026-02-18T03:24:07.533 INFO:teuthology.orchestra.run.trial034.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-18T03:24:07.533 INFO:teuthology.orchestra.run.trial034.stdout:Verifying podman|docker is present... 2026-02-18T03:24:07.549 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stdout 5.6.0 2026-02-18T03:24:07.549 INFO:teuthology.orchestra.run.trial034.stdout:Verifying lvm2 is present... 2026-02-18T03:24:07.549 INFO:teuthology.orchestra.run.trial034.stdout:Verifying time synchronization is in place... 2026-02-18T03:24:07.555 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-18T03:24:07.555 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-18T03:24:07.561 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-18T03:24:07.561 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:07.569 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout enabled 2026-02-18T03:24:07.575 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout active 2026-02-18T03:24:07.575 INFO:teuthology.orchestra.run.trial034.stdout:Unit chronyd.service is enabled and running 2026-02-18T03:24:07.575 INFO:teuthology.orchestra.run.trial034.stdout:Repeating the final host check... 2026-02-18T03:24:07.591 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stdout 5.6.0 2026-02-18T03:24:07.591 INFO:teuthology.orchestra.run.trial034.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-18T03:24:07.591 INFO:teuthology.orchestra.run.trial034.stdout:systemctl is present 2026-02-18T03:24:07.591 INFO:teuthology.orchestra.run.trial034.stdout:lvcreate is present 2026-02-18T03:24:07.596 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-18T03:24:07.596 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-18T03:24:07.602 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-18T03:24:07.602 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:07.608 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout enabled 2026-02-18T03:24:07.613 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout active 2026-02-18T03:24:07.613 INFO:teuthology.orchestra.run.trial034.stdout:Unit chronyd.service is enabled and running 2026-02-18T03:24:07.614 INFO:teuthology.orchestra.run.trial034.stdout:Host looks OK 2026-02-18T03:24:07.614 INFO:teuthology.orchestra.run.trial034.stdout:Cluster fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:07.614 INFO:teuthology.orchestra.run.trial034.stdout:Acquiring lock 140330732569360 on /run/cephadm/3ff67590-0c79-11f1-9051-d404e6e7d460.lock 2026-02-18T03:24:07.614 INFO:teuthology.orchestra.run.trial034.stdout:Lock 140330732569360 acquired on /run/cephadm/3ff67590-0c79-11f1-9051-d404e6e7d460.lock 2026-02-18T03:24:07.614 INFO:teuthology.orchestra.run.trial034.stdout:Verifying IP 10.20.193.34 port 3300 ... 2026-02-18T03:24:07.615 INFO:teuthology.orchestra.run.trial034.stdout:Verifying IP 10.20.193.34 port 6789 ... 2026-02-18T03:24:07.615 INFO:teuthology.orchestra.run.trial034.stdout:Base mon IP(s) is [10.20.193.34:3300, 10.20.193.34:6789], mon addrv is [v2:10.20.193.34:3300,v1:10.20.193.34:6789] 2026-02-18T03:24:07.617 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.34 metric 102 2026-02-18T03:24:07.617 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.34 metric 102 2026-02-18T03:24:07.617 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-18T03:24:07.620 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-18T03:24:07.620 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-18T03:24:07.620 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout inet6 fe80::a292:a3d1:2765:712c/64 scope link noprefixroute 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-18T03:24:07.623 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6032/64 scope link 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:Mon IP `10.20.193.34` is in CIDR network `10.20.192.0/20` 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:Mon IP `10.20.193.34` is in CIDR network `10.20.192.0/20` 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-18T03:24:07.624 INFO:teuthology.orchestra.run.trial034.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:24:07.862 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stdout c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc 2026-02-18T03:24:07.862 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed... 2026-02-18T03:24:07.862 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Getting image source signatures 2026-02-18T03:24:07.863 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Copying blob sha256:ddefcddf6ef03d04de1b3dcc9836d89822cd11e5095471fffeae38220180f545 2026-02-18T03:24:07.863 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-18T03:24:07.863 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Copying config sha256:c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc 2026-02-18T03:24:07.863 INFO:teuthology.orchestra.run.trial034.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-18T03:24:07.999 INFO:teuthology.orchestra.run.trial034.stdout:ceph: stdout ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable) 2026-02-18T03:24:07.999 INFO:teuthology.orchestra.run.trial034.stdout:Ceph version: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable) 2026-02-18T03:24:07.999 INFO:teuthology.orchestra.run.trial034.stdout:Extracting ceph user uid/gid from container image... 2026-02-18T03:24:08.130 INFO:teuthology.orchestra.run.trial034.stdout:stat: stdout 167 167 2026-02-18T03:24:08.130 INFO:teuthology.orchestra.run.trial034.stdout:Creating initial keys... 2026-02-18T03:24:08.273 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph-authtool: stdout AQDYMJVptc92DhAAv4DTDYYRQ4zg2D6envtzdQ== 2026-02-18T03:24:08.391 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph-authtool: stdout AQDYMJVpH86GFhAAm7Q4L0jwj2Bg+vHzpTb3LA== 2026-02-18T03:24:08.506 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph-authtool: stdout AQDYMJVpm/ZoHRAAZTcRAmkeE9GAKJsARe3RNQ== 2026-02-18T03:24:08.506 INFO:teuthology.orchestra.run.trial034.stdout:Creating initial monmap... 2026-02-18T03:24:08.639 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:monmaptool for a [v2:10.20.193.34:3300,v1:10.20.193.34:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:setting min_mon_release = tentacle 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: set fsid to 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:08.640 INFO:teuthology.orchestra.run.trial034.stdout:Creating mon... 2026-02-18T03:24:08.775 INFO:teuthology.orchestra.run.trial034.stdout:create mon.a on 2026-02-18T03:24:08.936 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-18T03:24:09.040 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-18T03:24:09.146 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target → /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target. 2026-02-18T03:24:09.147 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target → /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target. 2026-02-18T03:24:09.270 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:24:09.270 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service: Unit ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service not loaded. 2026-02-18T03:24:09.386 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target.wants/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service. 2026-02-18T03:24:09.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:09 trial034 podman[21363]: 2026-02-18 03:24:09.484911243 +0000 UTC m=+0.009495987 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:24:09.538 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:24:09.538 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout disabled 2026-02-18T03:24:09.547 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:24:09.547 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:09.547 INFO:teuthology.orchestra.run.trial034.stdout:firewalld.service is not enabled 2026-02-18T03:24:09.548 INFO:teuthology.orchestra.run.trial034.stdout:Not possible to enable service . firewalld.service is not available 2026-02-18T03:24:09.548 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mon to start... 2026-02-18T03:24:09.548 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mon... 2026-02-18T03:24:09.717 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout cluster: 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout services: 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.133638s) [leader: a] 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.718 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout data: 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout pgs: 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:mon is available 2026-02-18T03:24:09.719 INFO:teuthology.orchestra.run.trial034.stdout:Assimilating anything we can from ceph.conf... 2026-02-18T03:24:09.831 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:09 trial034 systemd[1]: Started Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:24:09.832 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:09 trial034 ceph-mon[21392]: mkfs 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:09.832 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:09 trial034 ceph-mon[21392]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:24:09.881 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.881 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [global] 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout fsid = 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.34:3300,v1:10.20.193.34:6789] 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-18T03:24:09.882 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:09.883 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [osd] 2026-02-18T03:24:09.883 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-18T03:24:09.883 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-18T03:24:09.883 INFO:teuthology.orchestra.run.trial034.stdout:Generating new minimal ceph.conf... 2026-02-18T03:24:10.049 INFO:teuthology.orchestra.run.trial034.stdout:Restarting the monitor... 2026-02-18T03:24:10.127 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 systemd[1]: Stopping Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:24:10.379 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[21388]: 2026-02-18T03:24:10.125+0000 7efe01c4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:24:10.379 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[21388]: 2026-02-18T03:24:10.125+0000 7efe01c4f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-18T03:24:10.548 INFO:teuthology.orchestra.run.trial034.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-18T03:24:10.631 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21673]: 2026-02-18 03:24:10.379006606 +0000 UTC m=+0.265261081 container died d65e84a4fb32031f94cbed524dae429e03aa06067854d4678e53c81a47dbaefc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS) 2026-02-18T03:24:10.631 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21673]: 2026-02-18 03:24:10.387299859 +0000 UTC m=+0.273554324 container remove d65e84a4fb32031f94cbed524dae429e03aa06067854d4678e53c81a47dbaefc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True) 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 bash[21673]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 systemd[1]: Stopped Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 systemd[1]: Starting Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21799]: 2026-02-18 03:24:10.516331873 +0000 UTC m=+0.016348894 container create 997bd3a5587b88a4afd97c35164c82e0c03db26a46e160cfb9430b81754e3429 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216) 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21799]: 2026-02-18 03:24:10.540777243 +0000 UTC m=+0.040794254 container init 997bd3a5587b88a4afd97c35164c82e0c03db26a46e160cfb9430b81754e3429 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21799]: 2026-02-18 03:24:10.543072122 +0000 UTC m=+0.043089133 container start 997bd3a5587b88a4afd97c35164c82e0c03db26a46e160cfb9430b81754e3429 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 bash[21799]: 997bd3a5587b88a4afd97c35164c82e0c03db26a46e160cfb9430b81754e3429 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 podman[21799]: 2026-02-18 03:24:10.5100119 +0000 UTC m=+0.010028911 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:24:10.632 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 systemd[1]: Started Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: pidfile_write: ignore empty --pid-file 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: load: jerasure load: lrc 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Git sha 0 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: DB SUMMARY 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: DB Session ID: JBFO83USA0BRNH5WAUUC 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:24:10.633 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 76937 ; 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.env: 0x564c4f333100 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.info_log: 0x564c559ebb00 2026-02-18T03:24:10.634 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.statistics: (nil) 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.use_fsync: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:24:10.635 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.db_log_dir: 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.wal_dir: 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.write_buffer_manager: 0x564c559ee500 2026-02-18T03:24:10.636 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.unordered_write: 0 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:24:10.637 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.row_cache: None 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.wal_filter: None 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.wal_compression: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:24:10.638 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:24:10.639 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_open_files: -1 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Compression algorithms supported: 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kZSTD supported: 0 2026-02-18T03:24:10.640 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:24:10.641 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.merge_operator: 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_filter: None 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c559ea240) 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: index_type: 0 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_index_type: 0 2026-02-18T03:24:10.642 INFO:journalctl@ceph.mon.a.trial034.stdout: index_shortening: 1 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: checksum: 4 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: no_block_cache: 0 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache: 0x564c55a0bb90 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_options: 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: capacity : 536870912 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: num_shard_bits : 4 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: strict_capacity_limit : 0 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_compressed: (nil) 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: persistent_cache: (nil) 2026-02-18T03:24:10.643 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size: 4096 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size_deviation: 10 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: block_restart_interval: 16 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: index_block_restart_interval: 1 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: metadata_block_size: 4096 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: partition_filters: 0 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: use_delta_encoding: 1 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: filter_policy: bloomfilter 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: whole_key_filtering: 1 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_compression: 0 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: format_version: 5 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_index_compression: 1 2026-02-18T03:24:10.644 INFO:journalctl@ceph.mon.a.trial034.stdout: block_align: 0 2026-02-18T03:24:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout: max_auto_readahead_size: 262144 2026-02-18T03:24:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout: prepopulate_block_cache: 0 2026-02-18T03:24:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:24:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:24:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression: NoCompression 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:24:10.646 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.num_levels: 7 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:24:10.647 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:24:10.648 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:24:10.649 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:24:10.650 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:24:10.651 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.ttl: 2592000 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:24:10.652 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:24:10.653 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8df5c88d-f7b2-4851-aabb-a44400590142 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385050571144, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-18T03:24:10.654 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-18T03:24:10.655 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385050571963, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 73913, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 231, "table_properties": {"data_size": 72188, "index_size": 174, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9888, "raw_average_key_size": 48, "raw_value_size": 66623, "raw_average_value_size": 329, "num_data_blocks": 8, "num_entries": 202, "num_filter_entries": 202, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771385050, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8df5c88d-f7b2-4851-aabb-a44400590142", "db_session_id": "JBFO83USA0BRNH5WAUUC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:24:10.655 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385050572037, "job": 1, "event": "recovery_finished"} 2026-02-18T03:24:10.655 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-18T03:24:10.655 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:24:10.655 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c55a0e700 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: DB pointer 0x564c55a20000 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout: ** DB Stats ** 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:24:10.656 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:24:10.657 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: L0 2/0 74.04 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: Sum 2/0 74.04 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:24:10.658 INFO:journalctl@ceph.mon.a.trial034.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:24:10.659 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative compaction: 0.00 GB write, 23.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval compaction: 0.00 GB write, 23.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:24:10.660 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache BinnedLRUCache@0x564c55a0bb90#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.72 KB,0.000137091%) IndexBlock(2,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: starting mon.a rank 0 at public addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] at bind addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???) e1 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).mds e1 new map 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).mds e1 print_map 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: e1 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:24:10.661 INFO:journalctl@ceph.mon.a.trial034.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout: legacy client fscid: -1 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout: No filesystems configured 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: monmap epoch 1 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:10.662 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: osdmap e1: 0 total, 0 up, 0 in 2026-02-18T03:24:10.663 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:10 trial034 ceph-mon[21825]: mgrmap e1: no daemons active 2026-02-18T03:24:10.722 INFO:teuthology.orchestra.run.trial034.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-18T03:24:10.723 INFO:teuthology.orchestra.run.trial034.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:10.723 INFO:teuthology.orchestra.run.trial034.stdout:Creating mgr... 2026-02-18T03:24:10.724 INFO:teuthology.orchestra.run.trial034.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-18T03:24:10.724 INFO:teuthology.orchestra.run.trial034.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-18T03:24:10.862 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x 2026-02-18T03:24:10.862 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service: Unit ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service not loaded. 2026-02-18T03:24:10.977 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460.target.wants/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service. 2026-02-18T03:24:11.124 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:24:11.124 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout disabled 2026-02-18T03:24:11.131 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:24:11.131 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:11.131 INFO:teuthology.orchestra.run.trial034.stdout:firewalld.service is not enabled 2026-02-18T03:24:11.131 INFO:teuthology.orchestra.run.trial034.stdout:Not possible to enable service . firewalld.service is not available 2026-02-18T03:24:11.138 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:24:11.138 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout disabled 2026-02-18T03:24:11.145 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:24:11.145 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:11.145 INFO:teuthology.orchestra.run.trial034.stdout:firewalld.service is not enabled 2026-02-18T03:24:11.145 INFO:teuthology.orchestra.run.trial034.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-18T03:24:11.146 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mgr to start... 2026-02-18T03:24:11.146 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mgr... 2026-02-18T03:24:11.325 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:24:11.326 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:11.327 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:24:11.328 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:24:09:561635+0000", 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:24:11.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:24:09.562323+0000", 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:11.330 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:24:11.331 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:11.331 INFO:teuthology.orchestra.run.trial034.stdout:mgr not available, waiting (1/15)... 2026-02-18T03:24:12.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1873700854' entity='client.admin' 2026-02-18T03:24:12.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/751517950' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:24:12.520 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: from numpy import show_config as show_numpy_config 2026-02-18T03:24:13.491 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:13.491 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:13.491 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:24:13.491 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:24:13.491 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:24:13.492 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:24:13.493 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:24:13.494 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:24:09:561635+0000", 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:24:13.495 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:24:09.562323+0000", 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:13.496 INFO:teuthology.orchestra.run.trial034.stdout:mgr not available, waiting (2/15)... 2026-02-18T03:24:13.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2646508166' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:24:14.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: Activating manager daemon x 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: mgrmap e2: x(active, starting, since 0.00265523s) 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: Manager daemon x is now available 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:24:14.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' 2026-02-18T03:24:14.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:24:14.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' 2026-02-18T03:24:14.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:14 trial034 ceph-mon[21825]: from='mgr.14100 10.20.193.34:0/608271612' entity='mgr.x' 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "health": { 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-18T03:24:15.777 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 0 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "a" 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:15.778 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-18T03:24:15.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-18T03:24:15.780 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "btime": "2026-02-18T03:24:09:561635+0000", 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-18T03:24:15.781 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ], 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "modified": "2026-02-18T03:24:09.562323+0000", 2026-02-18T03:24:15.782 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-18T03:24:15.783 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout }, 2026-02-18T03:24:15.783 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-18T03:24:15.783 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:15.783 INFO:teuthology.orchestra.run.trial034.stdout:mgr is available 2026-02-18T03:24:16.010 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [global] 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout fsid = 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.34:3300,v1:10.20.193.34:6789] 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-18T03:24:16.011 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout [osd] 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-18T03:24:16.012 INFO:teuthology.orchestra.run.trial034.stdout:Enabling cephadm module... 2026-02-18T03:24:16.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:15 trial034 ceph-mon[21825]: mgrmap e3: x(active, since 1.00614s) 2026-02-18T03:24:16.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3883620400' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-18T03:24:17.172 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:16 trial034 ceph-mon[21825]: mgrmap e4: x(active, since 2s) 2026-02-18T03:24:17.172 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2451080624' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-18T03:24:17.172 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2643196499' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-18T03:24:17.172 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: ignoring --setuser ceph since I am not root 2026-02-18T03:24:17.173 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: ignoring --setgroup ceph since I am not root 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:17.197 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for the mgr to restart... 2026-02-18T03:24:17.198 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mgr epoch 5... 2026-02-18T03:24:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2643196499' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-18T03:24:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:17 trial034 ceph-mon[21825]: mgrmap e5: x(active, since 3s) 2026-02-18T03:24:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3791000988' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:24:18.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-18T03:24:18.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-18T03:24:18.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: from numpy import show_config as show_numpy_config 2026-02-18T03:24:20.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: Active manager daemon x restarted 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: Activating manager daemon x 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: osdmap e2: 0 total, 0 up, 0 in 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: mgrmap e6: x(active, starting, since 0.00328187s) 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:24:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:24:20.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:24:20.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:24:20.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:19 trial034 ceph-mon[21825]: Manager daemon x is now available 2026-02-18T03:24:20.682 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:20.682 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-18T03:24:20.682 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-18T03:24:20.682 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:20.683 INFO:teuthology.orchestra.run.trial034.stdout:mgr epoch 5 is available 2026-02-18T03:24:20.683 INFO:teuthology.orchestra.run.trial034.stdout:Verifying orchestrator module is enabled... 2026-02-18T03:24:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: Found migration_current of "None". Setting to last migration. 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:20 trial034 ceph-mon[21825]: mgrmap e7: x(active, since 1.00545s) 2026-02-18T03:24:21.958 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-18T03:24:21.958 INFO:teuthology.orchestra.run.trial034.stdout:Setting orchestrator backend to cephadm... 2026-02-18T03:24:22.197 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:20] ENGINE Bus STARTING 2026-02-18T03:24:22.197 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:20] ENGINE Serving on http://10.20.193.34:8765 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:20] ENGINE Serving on https://10.20.193.34:7150 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:20] ENGINE Bus STARTED 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:20] ENGINE Client ('10.20.193.34', 37306) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:24:22.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2275053848' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-18T03:24:22.461 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-18T03:24:22.461 INFO:teuthology.orchestra.run.trial034.stdout:Generating ssh key... 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: Generating public/private ed25519 key pair. 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: Your identification has been saved in /tmp/tmpbpd_dmqa/key 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: Your public key has been saved in /tmp/tmpbpd_dmqa/key.pub 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: The key fingerprint is: 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: SHA256:UOOnZ+a6yFluA8jKpHXsg+65hry3BgKndQZoO6IFdX0 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: The key's randomart image is: 2026-02-18T03:24:22.711 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: +--[ED25519 256]--+ 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: | o. .. o | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |o... .oE. | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |.... ... . | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |oo+ o . o | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |+=.= . S + | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |+.o = . = | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |o*.= .. . | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: |o.=+o. =o. | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: | =Oo..+.+o | 2026-02-18T03:24:22.712 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: +----[SHA256]-----+ 2026-02-18T03:24:22.960 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:22.960 INFO:teuthology.orchestra.run.trial034.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:24:22.960 INFO:teuthology.orchestra.run.trial034.stdout:Adding key to root@localhost authorized_keys... 2026-02-18T03:24:22.961 INFO:teuthology.orchestra.run.trial034.stdout:Adding host trial034... 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2275053848' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: mgrmap e8: x(active, since 2s) 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:22.962 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:22 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:23 trial034 ceph-mon[21825]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:24.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:23 trial034 ceph-mon[21825]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:24.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:23 trial034 ceph-mon[21825]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:24.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:23 trial034 ceph-mon[21825]: Generating ssh key... 2026-02-18T03:24:24.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:23 trial034 ceph-mon[21825]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:24.825 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout Added host 'trial034' with addr '10.20.193.34' 2026-02-18T03:24:24.826 INFO:teuthology.orchestra.run.trial034.stdout:Deploying unmanaged mon service... 2026-02-18T03:24:25.072 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:24 trial034 ceph-mon[21825]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial034", "addr": "10.20.193.34", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:25.072 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:24 trial034 ceph-mon[21825]: Deploying cephadm binary to trial034 2026-02-18T03:24:25.072 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:24 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:25.072 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:24 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:25.093 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-18T03:24:25.093 INFO:teuthology.orchestra.run.trial034.stdout:Deploying unmanaged mgr service... 2026-02-18T03:24:25.349 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-18T03:24:25.857 INFO:teuthology.orchestra.run.trial034.stdout:Enabling the dashboard module... 2026-02-18T03:24:26.108 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: Added host trial034 2026-02-18T03:24:26.108 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:26.109 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:26.109 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:26.109 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:26.109 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1530882823' entity='client.admin' 2026-02-18T03:24:26.109 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2790558258' entity='client.admin' 2026-02-18T03:24:27.115 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: ignoring --setuser ceph since I am not root 2026-02-18T03:24:27.115 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: ignoring --setgroup ceph since I am not root 2026-02-18T03:24:27.115 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: Saving service mon spec with placement count:5 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: Saving service mgr spec with placement count:2 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3413123027' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-18T03:24:27.116 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:26 trial034 ceph-mon[21825]: from='mgr.14118 10.20.193.34:0/4059463142' entity='mgr.x' 2026-02-18T03:24:27.289 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:27.289 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-18T03:24:27.289 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-18T03:24:27.290 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-18T03:24:27.290 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-18T03:24:27.290 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:27.290 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for the mgr to restart... 2026-02-18T03:24:27.290 INFO:teuthology.orchestra.run.trial034.stdout:Waiting for mgr epoch 9... 2026-02-18T03:24:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3413123027' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-18T03:24:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:27 trial034 ceph-mon[21825]: mgrmap e9: x(active, since 7s) 2026-02-18T03:24:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2103208856' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-18T03:24:28.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-18T03:24:28.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-18T03:24:28.271 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: from numpy import show_config as show_numpy_config 2026-02-18T03:24:30.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: Active manager daemon x restarted 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: Activating manager daemon x 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: osdmap e3: 0 total, 0 up, 0 in 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: mgrmap e10: x(active, starting, since 0.00301156s) 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-18T03:24:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:29 trial034 ceph-mon[21825]: Manager daemon x is now available 2026-02-18T03:24:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-18T03:24:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-18T03:24:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: mgrmap e11: x(active, since 1.00569s) 2026-02-18T03:24:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout { 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout } 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:mgr epoch 9 is available 2026-02-18T03:24:31.329 INFO:teuthology.orchestra.run.trial034.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-18T03:24:32.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:30] ENGINE Bus STARTING 2026-02-18T03:24:32.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:30] ENGINE Serving on https://10.20.193.34:7150 2026-02-18T03:24:32.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:30] ENGINE Client ('10.20.193.34', 41942) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-18T03:24:32.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-18T03:24:32.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-18T03:24:32.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:30] ENGINE Serving on http://10.20.193.34:8765 2026-02-18T03:24:32.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:31 trial034 ceph-mon[21825]: [18/Feb/2026:03:24:30] ENGINE Bus STARTED 2026-02-18T03:24:32.280 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUJepnw4SDgDbfduPj8DKTKhxk+5EwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI2MDIxODAzMjQzMloXDTI5\nMDIxNzAzMjQzMlowFzEVMBMGA1UEAwwMMTAuMjAuMTkzLjM0MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAqmhiA3eSeVMUjtDvmvZ21DXsY5qkmqKqz5O3\nWNcxFxQN7KAchV2FoYhKcMZ9Sf5VFZsgWlPjnXu7DEFnDvi1bjI+O0+Am1tsmiGx\n0buOBEVFAiAm7OaXvGnYUhsH6+jlMGidllvVjc3hxtROiC8rg1wrFcGPE9KFDv2A\n7ZuUnxTX63D7Rda8ZCSA7dt7CKiXShME230o7YSwgREj3WJC0l3qzBMjBKgjWBhx\nl+7DHn0dvevAKIfKvKzIWd642incC8pRmP4TThFnjkzvJVF20T5RrwAncxaxFnP2\nuLKx+LKLqHjN4q5Q0/5bvhUJRabyrUZ4B4vI4rJjaxiBumIpL374Zrc/rGZMdTj3\nCLw7uTEGEIiiwh00etAL/gcdXAyB02JPGLa9zGVHnRjkKDxR7AE+xC7Fh0pCnDXf\nrkWsBMrC1MtEio2liQOq+WfdUV2yOcpd9mED67wwaiY2OxoNYDZ6bRkVqeue7wOA\nuvwvYYfrOw1paW2j5OxQrBBWe9gCJ8IOyRNXtL/lbTYJYKvR2YBm0Xh60Vhg6kFg\n3E+kcuxYWK2x1gyjAMtasPlelii1m8p+QyJ6s0vM1PX478GY1jp4V5C6l6Jgqzl6\nlVTb04dOGWtBGLPPiE7TbLd0rxYz8Nr3NZkPtux15YdckazjnXWoK/ZHG+93d8Eu\n623iQikCAwEAAaM+MDwwLAYDVR0RBCUwI4IIdHJpYWwwMzSCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwQKFMEiMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAHHa\n0fun/ohg/GrwGYasgkxuRMIyMACdVp2LEeSOhhRBlSpp7Iq79pqz+6ITaXIzP+fq\nHlQZIiaupgmJuvPm2+p9ZXjFmfJYAMr986NodU6lulYsrRaK5uKUWCfNM1aDkdWX\nUpy++3HSvvxoJzlCOCV8N2Wa5IX6UmPbcyZ2wkk2zrnzFzmR0+6SYuN1g+CIXptU\nbCtzf6qFT9XMX/7zSZq/i8ltIgMU/QgFUk88p/Oasilqz3Lys99oIVh6ef1cvS4p\nSFdDaa/i5xOJOTD0bhS9w5y9AqY5BTgKwdr1/8lCKnjBBq3tu760/5RvW94+gaNA\n0TCiDcqYAls9juzpdj9UCAVlOeSFQ7TGW1ioWWc9B3fz6Dw6UkLXjCN/sxi9HThA\nKXiXgua6Ue5bFovR8mhRycVryypoqrPDVKI39bZ6BSnxIUQ7BfNpK/gsu6S+GxP1\nnWzzbi9OsTgmMOez38fvsGAoi7CWkjtyc1t6HOI148hBBXq+1xu1/FjwGBvSKAko\nTLFiaSYBt3PiPJLKBX8k2bzkRxa1gwzfYTiBxwKG4tEVNbWlZ/MPnYd0qEXwkygO\nwR2m56wLCXqq44QFqin55lNQVALbElDpSI1tYgLM7cclmELR/7WkrdG5by/dZM9b\nemDaJeE2nlndvCzq4HAMjK3+pfNzHcfwYHIvDSgH\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAqmhiA3eSeVMUjtDvmvZ21DXsY5qkmqKqz5O3WNcxFxQN7KAc\nhV2FoYhKcMZ9Sf5VFZsgWlPjnXu7DEFnDvi1bjI+O0+Am1tsmiGx0buOBEVFAiAm\n7OaXvGnYUhsH6+jlMGidllvVjc3hxtROiC8rg1wrFcGPE9KFDv2A7ZuUnxTX63D7\nRda8ZCSA7dt7CKiXShME230o7YSwgREj3WJC0l3qzBMjBKgjWBhxl+7DHn0dvevA\nKIfKvKzIWd642incC8pRmP4TThFnjkzvJVF20T5RrwAncxaxFnP2uLKx+LKLqHjN\n4q5Q0/5bvhUJRabyrUZ4B4vI4rJjaxiBumIpL374Zrc/rGZMdTj3CLw7uTEGEIii\nwh00etAL/gcdXAyB02JPGLa9zGVHnRjkKDxR7AE+xC7Fh0pCnDXfrkWsBMrC1MtE\nio2liQOq+WfdUV2yOcpd9mED67wwaiY2OxoNYDZ6bRkVqeue7wOAuvwvYYfrOw1p\naW2j5OxQrBBWe9gCJ8IOyRNXtL/lbTYJYKvR2YBm0Xh60Vhg6kFg3E+kcuxYWK2x\n1gyjAMtasPlelii1m8p+QyJ6s0vM1PX478GY1jp4V5C6l6Jgqzl6lVTb04dOGWtB\nGLPPiE7TbLd0rxYz8Nr3NZkPtux15YdckazjnXWoK/ZHG+93d8Eu623iQikCAwEA\nAQKCAgAX/GjdbZGBv9K7NogfcxUvUibDr2L/fCmYXcW3PNUFV1aNac0R7aPPZKB7\nxsigZ2sBB0ySwk+d3Wpq83LG7fWVvP86+HoVBBWhjWAa8jAvhDOONMnd2yhdBjYD\nepgPGgFWoscZwLPqyaG/y6cBLsiMbScIYS4bP2zouwCQkW9mQ/gPhR/tSOhMHUJD\nmLr08UwYSlyK649c/WodxLScZwYaV8tircfmUidlcU1d8ibnTfunfb1WxyRfkd+C\nnOG+nZlCVJhPNWYwvSzrIAOiaFjV45R6UkZ7QeSr0SdXgJmh9LnJPTXXtCse5+Tw\neMQNGI58mthu0Xt1g2AQlUq/Wi1LLiK0yn5RFVCrHRHY/lESulGZTz20LyznSwuJ\nXigBPfh1/9CkbMOX0A1YrgiUhhVhDmRt+nAAXn4dFfA7TkYb3DePNKRQgmitcH9D\nysVKKEYPOdZG4g3hL5ADckK5bkC86Dc9jMI7jR2h7v2Hkc/Rq/YqzsktCvNFpCXE\nOdXJPUJ78f8ysabqz4Bj24GLhGDtLanrYZIpztHDCYeL/fgaAxltyEY2NfuGPfHG\nAP7yxwxvcoUlePpTc0QVXxpQ3ZeoyKLdJG8quYjDZxNatQzZPL+7MwTtrDWBJlEz\nbpyTpM2MwGM19N2WlAeo6FT70mlN2Bzd6bEdTloCVD0tPcsqfQKCAQEA0axL02/S\nXJ7JIsvWG7V//YFL7oUvrsQIIpu4L/KieBKTNyEhxMj6KOkvDo2SBRESD5v0iKqr\n6sCCJ6WFjicitJJtZTutFWghCo70eJHhju7nVPAfbxvNCA9O+36D881jbo2ZcUoo\nbsLTuWZSPYkjN7hMvUuCxkUQBF/XBjWEaEtk1vQkhA328bNhnqJe4ga74i/Ovf4a\n/oEv8ViW6PGi1JzCDgjJVttEe/97wxuJefBtcn3+pWSYLqn7ksxA7QUn5E36TGPa\nFlMPZJy3qxbU5qby8LNaN13lZhvVgM2X9WmupMmYN+vpiTzfiqkkA9nUNdQu1I+9\nLIXqt+kQnhhI9QKCAQEA0A8hV+9OSrT3Q/sBcmufWa6AqDZ+rsO+p8gxF0h9vAtK\ndPBdGcsC9pqzE0053Ileb4DDguOPhYrCD7BvkO0Xze00uc8G5XijiyqfVC7HSQzy\nWDFevouf7D5+oJgS0CHxKxOtqCXbGe9J1Qcgj4tfoMXTXFW2wFaGRkqOWpY22qQS\ncpNc+N2DC0cbB/GuJABCEu9HZk8UFP4yJiq83uFhWhvgD+wHM/WdyMZ5us3XOgHT\nMEBfoEYY2XoqTGf+3HGXgLmjIT0Sp7b4cw56gMWsaw1KdyL/9HFuoVvGbILTdaYI\n2eYW++3crOOl2XWoBkQCK3k2kY+MAtpxXjvUf8Gj5QKCAQBfBp1e+ED4pSY3VPZ2\nnG2jcOP+9/HCXSnqtXRmlqq3jIOX6rYpP4TQ4c3n5JWXIkNzO5U6E0/TFuhmG4hK\nAsah2/MkfEVXfFftNxjpRARcCT5iqmk0q/7idj2vkYkwB5fW1OoEBD4K5NWcIxmG\ntg52BFsTN5PPVCGMOftz3vFhazoKiZ+7EbEnncrSYHhsK+0e99fVF8MYMWiPEz1h\n2ZGYlmsEfUryyHFjWUi4BlTqJOMVjrDIOK0YCQXxZAzQ3xNTT1vvHxoKIB7L1JMR\nQUnAN03HdSGgEjgTbO34cDU8jmcOXCdWwN6YyjPt3fZqoGCi/MU0pOhxs0fLjh9v\n50W5AoIBAQDDKQ4bz+tehDVUXQRUccM9ekRQhR17jT0vYMc7kdHvK6Ah5L1Pzm/v\nJdlIB654wZoFeYDrK82adDfoQ5XDGcK0dQZ6LEnJwcmWZtqhOmfQjAZe16CJl6rh\nDRX2Se+Lr+rqf0Drcub8gsp8uny+aPvAcQ/7kqMj84VsNc8mBbVajYCIXNZe0llz\noLUoVHkGZ/+Sh0QwIYkyz+X2iywy3LJWtcMM7FctU/03MYVJxn9WeBPDNP799gKl\nLMS0evBDk4GLS5ZLPWBcVXLjafdbBxDeMc9hxUDV5/jf/pg3fNghiSbQTdXNZqcS\nvU76ljSP/AcVBFQ9YarxmjmxLOn9FIRJAoIBAQC+5/DrwfMKTWlttXLb3DvaP5lU\nL2+ZLTuHegjwZnSHpo2KQeeN38z4scRLtenJvI58b62CsjQeyIZudvTrUdVISTzF\nmJfoMt7rdzZgiY0/g98dBN2R+EQAWFDDgfAozwJwdy1RqY7ZbL1l1Nz0KM3nU8AY\ny4q1BzHomE9MqNO57Kq6oZQWIgsVLKgWQkdJBZ/858GEomaA4LY0ZbX7gOnkyRrr\nDdmnDUTAR3gxBklypaf+aE0tx6tzuz42pw24x0cHYQi6seS+hWdo9g8h7k4GEmKq\ny4YnEUngHFV/Wxo8GPRhHe4GSmA8TMAeHvMw7JyudRG7xBPNnn3voVUh4B1v\n-----END RSA PRIVATE KEY-----\n"} 2026-02-18T03:24:32.528 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-18T03:24:32.779 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-18T03:24:32.780 INFO:teuthology.orchestra.run.trial034.stdout:Creating initial admin user... 2026-02-18T03:24:33.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:32 trial034 ceph-mon[21825]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:33.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:32 trial034 ceph-mon[21825]: mgrmap e12: x(active, since 2s) 2026-02-18T03:24:33.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:33.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:33.245 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$KTTHC9CkuXuOEdfcj9z40eiQRvop9B4Muq5V5x4yd/Xy1qII/2T1m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771385073, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-18T03:24:33.246 INFO:teuthology.orchestra.run.trial034.stdout:Fetching dashboard port number... 2026-02-18T03:24:33.484 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stdout 8443 2026-02-18T03:24:33.494 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-18T03:24:33.494 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout disabled 2026-02-18T03:24:33.500 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-18T03:24:33.500 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:33.500 INFO:teuthology.orchestra.run.trial034.stdout:firewalld.service is not enabled 2026-02-18T03:24:33.500 INFO:teuthology.orchestra.run.trial034.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-18T03:24:33.501 INFO:teuthology.orchestra.run.trial034.stdout:Ceph Dashboard is now available at: 2026-02-18T03:24:33.501 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.501 INFO:teuthology.orchestra.run.trial034.stdout: URL: https://trial034:8443/ 2026-02-18T03:24:33.501 INFO:teuthology.orchestra.run.trial034.stdout: User: admin 2026-02-18T03:24:33.502 INFO:teuthology.orchestra.run.trial034.stdout: Password: eswwrqtmcr 2026-02-18T03:24:33.502 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.502 INFO:teuthology.orchestra.run.trial034.stdout:Saving cluster configuration to /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config directory 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.806 INFO:teuthology.orchestra.run.trial034.stdout:Or, if you are only running a single cluster on this host: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: ceph telemetry on 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout:For more information see: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:33.807 INFO:teuthology.orchestra.run.trial034.stdout:Bootstrap complete. 2026-02-18T03:24:33.813 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout static 2026-02-18T03:24:33.819 INFO:teuthology.orchestra.run.trial034.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-18T03:24:33.819 INFO:teuthology.orchestra.run.trial034.stdout:systemctl: stdout inactive 2026-02-18T03:24:33.819 INFO:teuthology.orchestra.run.trial034.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-18T03:24:33.969 INFO:tasks.cephadm:Fetching config... 2026-02-18T03:24:33.969 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:33.969 DEBUG:teuthology.orchestra.run.trial034:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-18T03:24:33.985 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-18T03:24:33.985 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:33.985 DEBUG:teuthology.orchestra.run.trial034:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/123170617' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-18T03:24:34.035 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1622866101' entity='client.admin' 2026-02-18T03:24:34.042 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-18T03:24:34.042 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:34.042 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-18T03:24:34.108 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-18T03:24:34.108 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:34.108 DEBUG:teuthology.orchestra.run.trial034:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-18T03:24:34.165 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-18T03:24:34.165 DEBUG:teuthology.orchestra.run.trial014:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:24:34.201 INFO:teuthology.orchestra.run.trial014.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:34.211 DEBUG:teuthology.orchestra.run.trial034:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:24:34.246 INFO:teuthology.orchestra.run.trial034.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:34.256 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:24:34.291 INFO:teuthology.orchestra.run.trial086.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:34.301 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:24:34.338 INFO:teuthology.orchestra.run.trial155.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:34.347 DEBUG:teuthology.orchestra.run.trial177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-18T03:24:34.382 INFO:teuthology.orchestra.run.trial177.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBwve6EjGzA9E5+FSJo7k7NxcSrnkHKsziLT+ALXp2Ir ceph-3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:34.391 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-18T03:24:34.509 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:34.771 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-18T03:24:34.771 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-18T03:24:34.890 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:35.174 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial014 2026-02-18T03:24:35.174 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:24:35.174 DEBUG:teuthology.orchestra.run.trial014:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:35.193 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:24:35.193 DEBUG:teuthology.orchestra.run.trial014:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:35.250 INFO:tasks.cephadm:Adding host trial014 to orchestrator... 2026-02-18T03:24:35.250 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host add trial014 2026-02-18T03:24:35.370 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial034", "name": "osd_memory_target"} : dispatch 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3301838317' entity='client.admin' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:35.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:35.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:35.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:37.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: Updating trial034:/etc/ceph/ceph.conf 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: Updating trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: Updating trial034:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: Updating trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial014", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:37.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:36 trial034 ceph-mon[21825]: Deploying cephadm binary to trial014 2026-02-18T03:24:37.161 INFO:teuthology.orchestra.run.trial034.stdout:Added host 'trial014' with addr '10.20.193.14' 2026-02-18T03:24:37.203 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:24:37.321 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:37.561 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:37.561 INFO:teuthology.orchestra.run.trial034.stdout:[{"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}] 2026-02-18T03:24:37.597 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial086 2026-02-18T03:24:37.597 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:24:37.597 DEBUG:teuthology.orchestra.run.trial086:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:37.614 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:24:37.614 DEBUG:teuthology.orchestra.run.trial086:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:37.670 INFO:tasks.cephadm:Adding host trial086 to orchestrator... 2026-02-18T03:24:37.670 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host add trial086 2026-02-18T03:24:37.790 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:37.847 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:37 trial034 ceph-mon[21825]: mgrmap e13: x(active, since 6s) 2026-02-18T03:24:37.847 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:37 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:37.847 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:37 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:37.848 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:37 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:37.848 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:37 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:38 trial034 ceph-mon[21825]: Added host trial014 2026-02-18T03:24:39.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:38 trial034 ceph-mon[21825]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:24:39.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:38 trial034 ceph-mon[21825]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial086", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:39.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.577 INFO:teuthology.orchestra.run.trial034.stdout:Added host 'trial086' with addr '10.20.193.86' 2026-02-18T03:24:39.617 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:24:39.735 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:39.850 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: Deploying cephadm binary to trial086 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:39.851 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:39.963 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:39.963 INFO:teuthology.orchestra.run.trial034.stdout:[{"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}, {"addr": "10.20.193.86", "hostname": "trial086", "labels": [], "status": ""}] 2026-02-18T03:24:40.001 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial155 2026-02-18T03:24:40.002 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:24:40.002 DEBUG:teuthology.orchestra.run.trial155:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:40.020 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:24:40.020 DEBUG:teuthology.orchestra.run.trial155:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:40.076 INFO:tasks.cephadm:Adding host trial155 to orchestrator... 2026-02-18T03:24:40.076 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host add trial155 2026-02-18T03:24:40.191 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:41.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: Updating trial014:/etc/ceph/ceph.conf 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: Updating trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: Updating trial014:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: Added host trial086 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: Updating trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:41.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:24:41.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:41.984 INFO:teuthology.orchestra.run.trial034.stdout:Added host 'trial155' with addr '10.20.193.155' 2026-02-18T03:24:42.023 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:24:42.046 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial155", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:42.046 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:42.046 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: Deploying cephadm binary to trial155 2026-02-18T03:24:42.046 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial086", "name": "osd_memory_target"} : dispatch 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:42.047 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:42.140 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:42.367 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:42.367 INFO:teuthology.orchestra.run.trial034.stdout:[{"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}, {"addr": "10.20.193.86", "hostname": "trial086", "labels": [], "status": ""}, {"addr": "10.20.193.155", "hostname": "trial155", "labels": [], "status": ""}] 2026-02-18T03:24:42.406 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial177 2026-02-18T03:24:42.406 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:24:42.406 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:42.425 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:24:42.425 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:42.481 INFO:tasks.cephadm:Adding host trial177 to orchestrator... 2026-02-18T03:24:42.482 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host add trial177 2026-02-18T03:24:42.599 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: Updating trial086:/etc/ceph/ceph.conf 2026-02-18T03:24:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: Updating trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: Updating trial086:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: Added host trial155 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: Updating trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:43 trial034 ceph-mon[21825]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:24:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:43 trial034 ceph-mon[21825]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:43 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:44.395 INFO:teuthology.orchestra.run.trial034.stdout:Added host 'trial177' with addr '10.20.193.177' 2026-02-18T03:24:44.436 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-18T03:24:44.553 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:44.784 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:24:44.784 INFO:teuthology.orchestra.run.trial034.stdout:[{"addr": "10.20.193.34", "hostname": "trial034", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}, {"addr": "10.20.193.86", "hostname": "trial086", "labels": [], "status": ""}, {"addr": "10.20.193.155", "hostname": "trial155", "labels": [], "status": ""}, {"addr": "10.20.193.177", "hostname": "trial177", "labels": [], "status": ""}] 2026-02-18T03:24:44.819 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-18T03:24:44.820 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd crush tunables default 2026-02-18T03:24:44.934 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: Deploying cephadm binary to trial177 2026-02-18T03:24:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial155", "name": "osd_memory_target"} : dispatch 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:45.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:45.984 INFO:teuthology.orchestra.run.trial034.stderr:adjusted tunables profile to default 2026-02-18T03:24:46.030 INFO:tasks.cephadm:Adding mon.a on trial034 2026-02-18T03:24:46.030 INFO:tasks.cephadm:Adding mon.b on trial086 2026-02-18T03:24:46.030 INFO:tasks.cephadm:Adding mon.c on trial155 2026-02-18T03:24:46.030 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch apply mon '3;trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c' 2026-02-18T03:24:46.151 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-18T03:24:46.151 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-18T03:24:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: Updating trial155:/etc/ceph/ceph.conf 2026-02-18T03:24:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: Updating trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: Updating trial155:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: Added host trial177 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: Updating trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3996633774' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-18T03:24:46.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:45 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:46.391 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mon update... 2026-02-18T03:24:46.431 DEBUG:teuthology.orchestra.run.trial086:mon.b> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service 2026-02-18T03:24:46.435 DEBUG:teuthology.orchestra.run.trial155:mon.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service 2026-02-18T03:24:46.438 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-18T03:24:46.438 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph mon dump -f json 2026-02-18T03:24:46.595 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:46.865 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:24:46.865 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":1,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:08.615934Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-18T03:24:46.866 INFO:teuthology.orchestra.run.trial155.stderr:dumped monmap epoch 1 2026-02-18T03:24:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3996633774' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:47.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:47.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/147492032' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:24:47.906 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-18T03:24:47.906 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph mon dump -f json 2026-02-18T03:24:48.029 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:24:48.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Updating trial177:/etc/ceph/ceph.conf 2026-02-18T03:24:48.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: from='client.14198 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:24:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Saving service mon spec with placement trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:24:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Updating trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:24:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:47 trial034 ceph-mon[21825]: Deploying daemon mon.c on trial155 2026-02-18T03:24:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:49 trial086 ceph-mon[24100]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-18T03:24:53.320 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:53 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: Deploying daemon mon.b on trial086 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:24:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: monmap epoch 2 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:48.010636+0000 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: mgrmap e13: x(active, since 23s) 2026-02-18T03:24:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: overall HEALTH_OK 2026-02-18T03:24:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:54.270 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:24:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: 2026-02-18T03:24:54.011+0000 7f3f88226640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-18T03:24:58.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: Deploying daemon mon.b on trial086 2026-02-18T03:24:58.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.a calling monitor election 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.c calling monitor election 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: monmap epoch 2 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: last_changed 2026-02-18T03:24:48.010636+0000 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: min_mon_release 20 (tentacle) 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: election_strategy: 1 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:24:58.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: fsmap 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mgrmap e13: x(active, since 23s) 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: overall HEALTH_OK 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.c calling monitor election 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.a calling monitor election 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.b calling monitor election 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: monmap epoch 3 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:24:58.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: min_mon_release 20 (tentacle) 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: election_strategy: 1 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: fsmap 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: mgrmap e13: x(active, since 28s) 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: overall HEALTH_OK 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:58.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:58.703 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:24:58.703 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2026-02-18T03:24:58.704 INFO:teuthology.orchestra.run.trial155.stderr:dumped monmap epoch 3 2026-02-18T03:24:58.704 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: mon.c calling monitor election 2026-02-18T03:24:58.704 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:58.704 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.704 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: mon.a calling monitor election 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: mon.b calling monitor election 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:24:58.705 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: monmap epoch 3 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: min_mon_release 20 (tentacle) 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: election_strategy: 1 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: fsmap 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: mgrmap e13: x(active, since 28s) 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: overall HEALTH_OK 2026-02-18T03:24:58.706 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:58.707 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:58.765 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-18T03:24:58.766 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-18T03:24:58.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: mon.b calling monitor election 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:24:58.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: osdmap e4: 0 total, 0 up, 0 in 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: mgrmap e13: x(active, since 28s) 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: overall HEALTH_OK 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:58.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:58.893 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:24:59.120 INFO:teuthology.orchestra.run.trial034.stdout:# minimal ceph.conf for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:59.120 INFO:teuthology.orchestra.run.trial034.stdout:[global] 2026-02-18T03:24:59.120 INFO:teuthology.orchestra.run.trial034.stdout: fsid = 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:24:59.120 INFO:teuthology.orchestra.run.trial034.stdout: mon_host = [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] 2026-02-18T03:24:59.158 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-18T03:24:59.158 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:24:59.158 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:59.186 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:24:59.187 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:59.251 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:59.251 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:59.277 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:24:59.277 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:59.342 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:24:59.342 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:59.371 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:24:59.371 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:59.436 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:24:59.436 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:59.463 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:24:59.463 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial034:/etc/ceph/ceph.conf 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial014:/etc/ceph/ceph.conf 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial086:/etc/ceph/ceph.conf 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial155:/etc/ceph/ceph.conf 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial177:/etc/ceph/ceph.conf 2026-02-18T03:24:59.524 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Updating trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.525 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Reconfiguring daemon mon.a on trial034 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3906286711' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.526 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: Reconfiguring daemon mon.b on trial086 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/891534346' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:59.527 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.528 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.528 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:59.528 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.528 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:59.528 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:24:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.529 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:24:59.530 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.conf 2026-02-18T03:24:59.557 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:24:59.557 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:24:59.621 INFO:tasks.cephadm:Adding mgr.x on trial034 2026-02-18T03:24:59.621 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch apply mgr '1;trial034=x' 2026-02-18T03:24:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial034:/etc/ceph/ceph.conf 2026-02-18T03:24:59.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial014:/etc/ceph/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial086:/etc/ceph/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial155:/etc/ceph/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial177:/etc/ceph/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Updating trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Reconfiguring daemon mon.a on trial034 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3906286711' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: Reconfiguring daemon mon.b on trial086 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/891534346' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:59.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:24:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial034:/etc/ceph/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial014:/etc/ceph/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial086:/etc/ceph/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial155:/etc/ceph/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial177:/etc/ceph/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Updating trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Reconfiguring mon.a (unknown last config time)... 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Reconfiguring daemon mon.a on trial034 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3906286711' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Reconfiguring mon.b (monmap changed)... 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: Reconfiguring daemon mon.b on trial086 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/891534346' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:24:59.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:24:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:24:59.777 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:25:00.017 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mgr update... 2026-02-18T03:25:00.056 DEBUG:tasks.cephadm:set 0 configs 2026-02-18T03:25:00.056 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph config dump 2026-02-18T03:25:00.173 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:25:00.415 INFO:teuthology.orchestra.run.trial034.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-18T03:25:00.415 INFO:teuthology.orchestra.run.trial034.stdout:global dev auth_debug true 2026-02-18T03:25:00.415 INFO:teuthology.orchestra.run.trial034.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c * 2026-02-18T03:25:00.415 INFO:teuthology.orchestra.run.trial034.stdout:global dev debug_asserts_on_shutdown true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global basic log_to_file true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global basic log_to_journald false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global basic log_to_stderr false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_allow_pool_delete true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_cluster_log_to_file true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global dev mon_warn_on_pool_no_app false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global dev ms_die_on_bug true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global dev ms_die_on_old_message true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced debug_mon 20/20 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced debug_ms 1/1 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced debug_paxos 20/20 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_data_avail_warn 5 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced debug_mgr 20/20 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced debug_ms 1/1 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-18T03:25:00.416 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev bdev_debug_aio true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced debug_ms 1/1 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced debug_osd 20/20 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_misdirected_ops true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_op_order true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_shutdown true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_memory_target_autotune true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_op_queue debug_random * 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_recover_clone_overlap true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-18T03:25:00.417 INFO:teuthology.orchestra.run.trial034.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-18T03:25:00.454 INFO:tasks.cephadm:Deploying OSDs... 2026-02-18T03:25:00.455 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:25:00.455 DEBUG:teuthology.orchestra.run.trial014:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:25:00.472 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:25:00.472 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_1 2026-02-18T03:25:00.528 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:25:00.528 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:00.528 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1600 Links: 1 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-18 03:24:38.893904022 +0000 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:00.529 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:00.529 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:25:00.591 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-18T03:25:00.591 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-18T03:25:00.591 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000170154 s, 3.0 MB/s 2026-02-18T03:25:00.592 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:25:00.649 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_2 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1590 Links: 1 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-18 03:24:38.893904022 +0000 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-18 03:23:46.477376149 +0000 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-18 03:23:46.477376149 +0000 2026-02-18T03:25:00.707 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-18 03:23:46.477376149 +0000 2026-02-18T03:25:00.707 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:25:00.770 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-18T03:25:00.770 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-18T03:25:00.770 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000134448 s, 3.8 MB/s 2026-02-18T03:25:00.771 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:25:00.828 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_3 2026-02-18T03:25:00.884 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:25:00.884 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:00.884 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1609 Links: 1 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-18 03:24:38.893904022 +0000 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-18 03:23:46.479376100 +0000 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-18 03:23:46.479376100 +0000 2026-02-18T03:25:00.885 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-18 03:23:46.479376100 +0000 2026-02-18T03:25:00.885 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:25:00.948 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-18T03:25:00.949 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-18T03:25:00.949 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000143204 s, 3.6 MB/s 2026-02-18T03:25:00.950 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:25:01.007 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_4 2026-02-18T03:25:01.063 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1597 Links: 1 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-18 03:24:38.893904022 +0000 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:01.064 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-18 03:23:46.478376124 +0000 2026-02-18T03:25:01.065 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:25:01.128 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-18T03:25:01.128 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-18T03:25:01.128 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000170034 s, 3.0 MB/s 2026-02-18T03:25:01.129 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:25:01.186 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:25:01.187 DEBUG:teuthology.orchestra.run.trial034:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:25:01.207 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:25:01.207 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_1 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1582 Links: 1 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-18 03:24:34.757176710 +0000 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.263 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.264 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.264 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:25:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: Reconfiguring daemon mon.c on trial155 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial034=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: Saving service mgr spec with placement trial034=x;count:1 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/694174220' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:25:01.296 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-18T03:25:01.296 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-18T03:25:01.296 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000147735 s, 3.5 MB/s 2026-02-18T03:25:01.297 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:25:01.353 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_2 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: Reconfiguring daemon mon.c on trial155 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial034=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: Saving service mgr spec with placement trial034=x;count:1 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:01 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/694174220' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:25:01.408 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:25:01.408 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.408 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1581 Links: 1 2026-02-18T03:25:01.408 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.408 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.409 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-18 03:24:34.757176710 +0000 2026-02-18T03:25:01.409 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.409 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.409 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-18 03:23:43.495862506 +0000 2026-02-18T03:25:01.409 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:25:01.471 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-18T03:25:01.472 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-18T03:25:01.472 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000153505 s, 3.3 MB/s 2026-02-18T03:25:01.473 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:25:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: Reconfiguring mon.c (monmap changed)... 2026-02-18T03:25:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: Reconfiguring daemon mon.c on trial155 2026-02-18T03:25:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial034=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: Saving service mgr spec with placement trial034=x;count:1 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:01.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:01 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/694174220' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-18T03:25:01.531 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_3 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1599 Links: 1 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-18 03:24:34.757176710 +0000 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-18 03:23:43.497862456 +0000 2026-02-18T03:25:01.587 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-18 03:23:43.497862456 +0000 2026-02-18T03:25:01.588 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-18 03:23:43.497862456 +0000 2026-02-18T03:25:01.588 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:25:01.650 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-18T03:25:01.650 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-18T03:25:01.650 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000154407 s, 3.3 MB/s 2026-02-18T03:25:01.651 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:25:01.709 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_4 2026-02-18T03:25:01.765 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:25:01.765 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.765 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1593 Links: 1 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-18 03:24:34.757176710 +0000 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-18 03:23:43.496862481 +0000 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-18 03:23:43.496862481 +0000 2026-02-18T03:25:01.766 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-18 03:23:43.496862481 +0000 2026-02-18T03:25:01.766 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:25:01.828 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-18T03:25:01.828 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-18T03:25:01.829 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000149108 s, 3.4 MB/s 2026-02-18T03:25:01.830 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:25:01.886 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:25:01.886 DEBUG:teuthology.orchestra.run.trial086:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:25:01.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:25:01.905 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_1 2026-02-18T03:25:01.961 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:25:01.961 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:01.961 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1582 Links: 1 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-18 03:24:48.996149152 +0000 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:01.962 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:01.962 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:25:02.024 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-18T03:25:02.024 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-18T03:25:02.025 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000151497 s, 3.4 MB/s 2026-02-18T03:25:02.026 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:25:02.083 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_2 2026-02-18T03:25:02.139 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:25:02.139 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:02.139 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1591 Links: 1 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-18 03:24:48.996149152 +0000 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.140 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.140 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:25:02.203 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-18T03:25:02.203 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-18T03:25:02.203 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.00014729 s, 3.5 MB/s 2026-02-18T03:25:02.205 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:25:02.262 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_3 2026-02-18T03:25:02.318 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:25:02.318 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:02.318 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1599 Links: 1 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-18 03:24:48.996149152 +0000 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.319 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.319 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:25:02.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:02 trial086 ceph-mon[24100]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:25:02.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:02 trial086 ceph-mon[24100]: Reconfiguring daemon mgr.x on trial034 2026-02-18T03:25:02.381 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-18T03:25:02.381 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-18T03:25:02.381 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000183098 s, 2.8 MB/s 2026-02-18T03:25:02.382 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:25:02.438 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_4 2026-02-18T03:25:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:02 trial155 ceph-mon[24719]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:25:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:02 trial155 ceph-mon[24719]: Reconfiguring daemon mgr.x on trial034 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1595 Links: 1 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-18 03:24:48.997149127 +0000 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.493 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-18 03:23:47.221341519 +0000 2026-02-18T03:25:02.493 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:25:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:02 trial034 ceph-mon[21825]: Reconfiguring mgr.x (unknown last config time)... 2026-02-18T03:25:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:02 trial034 ceph-mon[21825]: Reconfiguring daemon mgr.x on trial034 2026-02-18T03:25:02.555 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-18T03:25:02.555 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-18T03:25:02.555 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000149093 s, 3.4 MB/s 2026-02-18T03:25:02.556 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:25:02.612 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:25:02.612 DEBUG:teuthology.orchestra.run.trial155:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:25:02.630 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:25:02.630 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_1 2026-02-18T03:25:02.687 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1585 Links: 1 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-18 03:24:47.775220469 +0000 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.688 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.689 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:25:02.750 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-18T03:25:02.750 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-18T03:25:02.751 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000165409 s, 3.1 MB/s 2026-02-18T03:25:02.752 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:25:02.810 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_2 2026-02-18T03:25:02.865 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:25:02.865 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1601 Links: 1 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-18 03:24:47.775220469 +0000 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.866 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:02.867 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:25:02.929 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-18T03:25:02.930 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-18T03:25:02.930 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000155049 s, 3.3 MB/s 2026-02-18T03:25:02.931 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:25:02.988 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_3 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1596 Links: 1 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-18 03:24:47.775220469 +0000 2026-02-18T03:25:03.045 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.046 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.046 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.046 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:25:03.107 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-18T03:25:03.107 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-18T03:25:03.107 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000149319 s, 3.4 MB/s 2026-02-18T03:25:03.109 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:25:03.165 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_4 2026-02-18T03:25:03.221 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1594 Links: 1 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-18 03:24:47.776220444 +0000 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.222 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-18 03:23:50.117154662 +0000 2026-02-18T03:25:03.222 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:25:03.282 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:03 trial155 ceph-mon[24719]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:03.284 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-18T03:25:03.284 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-18T03:25:03.284 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.00015554 s, 3.3 MB/s 2026-02-18T03:25:03.285 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:25:03.343 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:25:03.343 DEBUG:teuthology.orchestra.run.trial177:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T03:25:03.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T03:25:03.362 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_1 2026-02-18T03:25:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:03 trial086 ceph-mon[24100]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:03.418 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T03:25:03.418 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1603 Links: 1 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-18 03:24:46.120375730 +0000 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.419 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.419 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T03:25:03.482 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-18T03:25:03.483 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-18T03:25:03.483 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.00015126 s, 3.4 MB/s 2026-02-18T03:25:03.484 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T03:25:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:03 trial034 ceph-mon[21825]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:03.543 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_2 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1598 Links: 1 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-18 03:24:46.120375730 +0000 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.601 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.602 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T03:25:03.665 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-18T03:25:03.665 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-18T03:25:03.666 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000132716 s, 3.9 MB/s 2026-02-18T03:25:03.667 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T03:25:03.723 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_3 2026-02-18T03:25:03.779 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T03:25:03.779 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.779 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1587 Links: 1 2026-02-18T03:25:03.779 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.780 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.780 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-18 03:24:46.120375730 +0000 2026-02-18T03:25:03.780 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.780 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.780 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.780 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T03:25:03.842 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-18T03:25:03.843 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-18T03:25:03.843 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000158955 s, 3.2 MB/s 2026-02-18T03:25:03.844 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T03:25:03.901 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_4 2026-02-18T03:25:03.956 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1592 Links: 1 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-18 03:24:46.120375730 +0000 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.957 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-18 03:23:47.854043648 +0000 2026-02-18T03:25:03.958 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T03:25:04.021 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-18T03:25:04.021 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-18T03:25:04.022 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000135321 s, 3.8 MB/s 2026-02-18T03:25:04.023 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T03:25:04.081 INFO:tasks.cephadm:Deploying osd.0 on trial034 with /dev/vg_nvme/lv_4... 2026-02-18T03:25:04.081 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:25:04.199 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:25:04.642 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:25:04.660 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_4 --skip-validation 2026-02-18T03:25:04.779 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:25:05.283 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:05 trial034 ceph-mon[21825]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:05.284 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.284 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.284 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:05.284 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:05 trial086 ceph-mon[24100]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:05 trial155 ceph-mon[24719]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.074 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"} : dispatch 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"}]': finished 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:25:06.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"} : dispatch 2026-02-18T03:25:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"}]': finished 2026-02-18T03:25:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:25:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_4'] 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"} : dispatch 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/561643914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70ae662f-a3ac-441d-9153-38a88a7bf842"}]': finished 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: osdmap e5: 1 total, 0 up, 1 in 2026-02-18T03:25:06.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:07.134 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:07 trial034 ceph-mon[21825]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:07.135 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/907028478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:07 trial086 ceph-mon[24100]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:07 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/907028478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:07 trial155 ceph-mon[24719]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:07 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/907028478' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:08.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:08.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-18T03:25:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:09.319 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:09 trial034 ceph-mon[21825]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.319 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:09 trial034 ceph-mon[21825]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.319 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:09 trial034 ceph-mon[21825]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:09 trial086 ceph-mon[24100]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:09 trial086 ceph-mon[24100]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:09 trial086 ceph-mon[24100]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:09 trial155 ceph-mon[24719]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:09 trial155 ceph-mon[24719]: Deploying daemon osd.0 on trial034 2026-02-18T03:25:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:09 trial155 ceph-mon[24719]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.645 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:10 trial034 ceph-mon[21825]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:10.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:10 trial155 ceph-mon[24719]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:10 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:10 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:10 trial086 ceph-mon[24100]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:12.956 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-18T03:25:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:12.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:13.047 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 0 on host 'trial034' 2026-02-18T03:25:13.088 DEBUG:teuthology.orchestra.run.trial034:osd.0> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.0.service 2026-02-18T03:25:13.091 INFO:tasks.cephadm:Deploying osd.1 on trial034 with /dev/vg_nvme/lv_3... 2026-02-18T03:25:13.091 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-18T03:25:13.252 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.802 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.802 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0[35656]: 2026-02-18T03:25:13.568+0000 7ff2104c3640 -1 osd.0 0 waiting for initial osdmap 2026-02-18T03:25:13.802 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0[35656]: 2026-02-18T03:25:13.570+0000 7ff207aa3640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:13.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:25:13.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:25:13.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:13.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:13.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: osdmap e6: 1 total, 0 up, 1 in 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.004 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:25:14.020 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial034:vg_nvme/lv_3 --skip-validation 2026-02-18T03:25:14.137 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:25:14.675 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:14.675 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:25:14.675 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: Detected new or changed devices on trial034 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.676 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: Detected new or changed devices on trial034 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: osdmap e7: 1 total, 0 up, 1 in 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: Detected new or changed devices on trial034 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial034 to 84047M 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375] boot 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: osdmap e8: 1 total, 1 up, 1 in 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"} : dispatch 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"}]': finished 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:25:15.702 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375] boot 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: osdmap e8: 1 total, 1 up, 1 in 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"} : dispatch 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"}]': finished 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:25:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:15 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial034:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial034:['vg_nvme/lv_3'] 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: Marking host: trial034 for OSDSpec preview refresh. 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial034 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: osd.0 [v2:10.20.193.34:6802/1922915375,v1:10.20.193.34:6803/1922915375] boot 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: osdmap e8: 1 total, 1 up, 1 in 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"} : dispatch 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1638556748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b"}]': finished 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: osdmap e9: 2 total, 1 up, 2 in 2026-02-18T03:25:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:15 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:16.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/276485277' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:16.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:16 trial034 ceph-mon[21825]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:16.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:16 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/276485277' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:16.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:16 trial086 ceph-mon[24100]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:16.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:16 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/276485277' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:16.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:16 trial155 ceph-mon[24719]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:18.206 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.206 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.206 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:18.206 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:25:18.206 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:18.207 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: Deploying daemon osd.1 on trial034 2026-02-18T03:25:18.207 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.207 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.207 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:18 trial034 ceph-mon[21825]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:25:18.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:18.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: Deploying daemon osd.1 on trial034 2026-02-18T03:25:18.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:18 trial086 ceph-mon[24100]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: Deploying daemon osd.1 on trial034 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:18 trial155 ceph-mon[24719]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: Detected new or changed devices on trial034 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:20 trial155 ceph-mon[24719]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:25:20.481 INFO:teuthology.orchestra.run.trial034.stdout:Created osd(s) 1 on host 'trial034' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: Detected new or changed devices on trial034 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:20.481 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:20 trial034 ceph-mon[21825]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:25:20.521 DEBUG:teuthology.orchestra.run.trial034:osd.1> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.1.service 2026-02-18T03:25:20.522 INFO:tasks.cephadm:Deploying osd.2 on trial086 with /dev/vg_nvme/lv_4... 2026-02-18T03:25:20.523 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: Detected new or changed devices on trial034 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:20.546 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:20 trial086 ceph-mon[24100]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-18T03:25:20.642 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:21.113 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:25:21.131 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial086:vg_nvme/lv_4 --skip-validation 2026-02-18T03:25:21.292 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:21 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:21.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:21 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: osdmap e10: 2 total, 1 up, 2 in 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]} : dispatch 2026-02-18T03:25:21.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:21 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.055 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1[41793]: 2026-02-18T03:25:21.787+0000 7fb95c772640 -1 osd.1 0 waiting for initial osdmap 2026-02-18T03:25:22.056 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1[41793]: 2026-02-18T03:25:21.790+0000 7fb953d52640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:22.573 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:22.573 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:22.573 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_4'] 2026-02-18T03:25:22.573 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: osdmap e11: 2 total, 1 up, 2 in 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:22.574 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2704938055' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"}]': finished 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680] boot 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:22 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_4'] 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:22.758 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: osdmap e11: 2 total, 1 up, 2 in 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.759 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2704938055' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"}]': finished 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680] boot 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.760 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:22 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:22.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_4'] 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:22.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial034", "root=default"]}]': finished 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: osdmap e11: 2 total, 1 up, 2 in 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2704938055' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"} : dispatch 2026-02-18T03:25:22.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "400d5239-cf11-4fca-8002-3840445a1f00"}]': finished 2026-02-18T03:25:22.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: osd.1 [v2:10.20.193.34:6810/93492680,v1:10.20.193.34:6811/93492680] boot 2026-02-18T03:25:22.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: osdmap e12: 3 total, 2 up, 3 in 2026-02-18T03:25:22.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-18T03:25:22.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:22 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2999535477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.684 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:23.685 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:23.685 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.685 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:23.685 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:23.685 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:23 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2999535477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:23.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:23 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2999535477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:23 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.825 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-18T03:25:24.825 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:24.825 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:24.826 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.826 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:24.826 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:24.826 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:24 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:24.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:24 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:25.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial034 to 42023M 2026-02-18T03:25:25.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:25.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:25.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:25.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:25.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-18T03:25:25.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:24 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:25.820 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:25 trial086 ceph-mon[24100]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:25.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:25 trial155 ceph-mon[24719]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:26.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:25 trial034 ceph-mon[21825]: Deploying daemon osd.2 on trial086 2026-02-18T03:25:27.182 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:27 trial086 ceph-mon[24100]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:27.182 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:27.182 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:27 trial155 ceph-mon[24719]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:27 trial034 ceph-mon[21825]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:28.909 INFO:teuthology.orchestra.run.trial086.stdout:Created osd(s) 2 on host 'trial086' 2026-02-18T03:25:28.952 DEBUG:teuthology.orchestra.run.trial086:osd.2> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.2.service 2026-02-18T03:25:28.955 INFO:tasks.cephadm:Deploying osd.3 on trial086 with /dev/vg_nvme/lv_3... 2026-02-18T03:25:28.955 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-18T03:25:29.113 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:29 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:29 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-18T03:25:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:29 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.074 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:25:30.092 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial086:vg_nvme/lv_3 --skip-validation 2026-02-18T03:25:30.210 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:30.440 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:25:30.440 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.441 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:30 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.442 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2[29014]: 2026-02-18T03:25:30.175+0000 7fd2ca48b640 -1 osd.2 0 waiting for initial osdmap 2026-02-18T03:25:30.442 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2[29014]: 2026-02-18T03:25:30.177+0000 7fd2c5a73640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:30.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:30.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:30 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: osdmap e13: 3 total, 2 up, 3 in 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:30 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_3'] 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: Detected new or changed devices on trial086 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial086 to 88143M 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_3'] 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: Detected new or changed devices on trial086 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial086 to 88143M 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: osdmap e14: 3 total, 2 up, 3 in 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_3'] 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: Detected new or changed devices on trial086 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial086 to 88143M 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:32.436 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:32.436 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:32.436 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.436 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450] boot 2026-02-18T03:25:32.436 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: osdmap e15: 3 total, 3 up, 3 in 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3233173522' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"}]': finished 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/4140195357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:32.437 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450] boot 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: osdmap e15: 3 total, 3 up, 3 in 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3233173522' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"}]': finished 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/4140195357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:32.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:32.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: osd.2 [v2:10.20.193.86:6800/1601265450,v1:10.20.193.86:6801/1601265450] boot 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: osdmap e15: 3 total, 3 up, 3 in 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3233173522' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"} : dispatch 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded6c259-415d-461a-a5ce-a00d62bd73fa"}]': finished 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: osdmap e16: 4 total, 3 up, 4 in 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:32.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4140195357' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:32.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-18T03:25:32.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.548 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46517]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46517]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46517]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46521]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46521]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.604 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46521]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46525]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46529]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.605 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46529]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.605 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46533]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: osdmap e17: 4 total, 3 up, 4 in 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-18T03:25:33.656 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33863]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33863]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33863]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33871]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33871]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.798 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33871]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33922]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33922]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33922]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.798 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:33 trial086 sudo[33926]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26014]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26014]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26014]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26018]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26018]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:33.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:33 trial155 sudo[26018]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46533]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46533]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46537]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46537]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-18T03:25:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:33 trial034 sudo[46537]: pam_unix(sudo:session): session closed for user root 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.596 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:34 trial086 ceph-mon[24100]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:34 trial155 ceph-mon[24719]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: Deploying daemon osd.3 on trial086 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: osdmap e18: 4 total, 3 up, 4 in 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:34.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:34 trial034 ceph-mon[21825]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:35.369 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:35 trial086 ceph-mon[24100]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:25:35.369 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:35 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:35.369 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:35 trial086 ceph-mon[24100]: mgrmap e14: x(active, since 64s) 2026-02-18T03:25:35.369 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:35 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:35.369 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:35 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:35.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:35 trial155 ceph-mon[24719]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:25:35.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:35 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:35.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:35 trial155 ceph-mon[24719]: mgrmap e14: x(active, since 64s) 2026-02-18T03:25:35.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:35 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:35.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:35 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:35 trial034 ceph-mon[21825]: osdmap e19: 4 total, 3 up, 4 in 2026-02-18T03:25:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:35 trial034 ceph-mon[21825]: mgrmap e14: x(active, since 64s) 2026-02-18T03:25:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:35.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:35 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:36 trial086 ceph-mon[24100]: pgmap v42: 1 pgs: 1 unknown; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:36.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:36 trial155 ceph-mon[24719]: pgmap v42: 1 pgs: 1 unknown; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:36.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:36 trial034 ceph-mon[21825]: pgmap v42: 1 pgs: 1 unknown; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:37.806 INFO:teuthology.orchestra.run.trial086.stdout:Created osd(s) 3 on host 'trial086' 2026-02-18T03:25:37.847 DEBUG:teuthology.orchestra.run.trial086:osd.3> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.3.service 2026-02-18T03:25:37.849 INFO:tasks.cephadm:Deploying osd.4 on trial086 with /dev/vg_nvme/lv_2... 2026-02-18T03:25:37.850 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-18T03:25:38.009 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:38 trial086 ceph-mon[24100]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:38 trial155 ceph-mon[24719]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:38 trial034 ceph-mon[21825]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:38.973 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:25:38.989 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial086:vg_nvme/lv_2 --skip-validation 2026-02-18T03:25:39.111 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:25:39.345 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.346 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:39 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.347 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:25:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3[35377]: 2026-02-18T03:25:39.068+0000 7fe012ed5640 -1 osd.3 0 waiting for initial osdmap 2026-02-18T03:25:39.347 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:25:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3[35377]: 2026-02-18T03:25:39.071+0000 7fe009ca1640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:39 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-18T03:25:39.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: osdmap e20: 4 total, 3 up, 4 in 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:40.340 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_2'] 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: Detected new or changed devices on trial086 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.341 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial086 to 44071M 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:40.342 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288] boot 2026-02-18T03:25:40.343 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:25:40.343 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:40 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_2'] 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.380 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: Detected new or changed devices on trial086 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.381 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial086 to 44071M 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288] boot 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:25:40.382 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:40 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: osdmap e21: 4 total, 3 up, 4 in 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial086:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial086:['vg_nvme/lv_2'] 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: Marking host: trial086 for OSDSpec preview refresh. 2026-02-18T03:25:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial086 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: Detected new or changed devices on trial086 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:40.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial086 to 44071M 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: osd.3 [v2:10.20.193.86:6808/3991930288,v1:10.20.193.86:6809/3991930288] boot 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: osdmap e22: 4 total, 4 up, 4 in 2026-02-18T03:25:40.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-18T03:25:41.337 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:41.337 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:41.337 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/4145744864' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.337 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.337 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"}]': finished 2026-02-18T03:25:41.338 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: osdmap e23: 5 total, 4 up, 5 in 2026-02-18T03:25:41.338 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:41.338 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:41 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/1143013650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/4145744864' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"}]': finished 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: osdmap e23: 5 total, 4 up, 5 in 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:41 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1143013650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4145744864' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"} : dispatch 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e189d7-b2a5-4897-a57e-592fc1d618e4"}]': finished 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: osdmap e23: 5 total, 4 up, 5 in 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1143013650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: osdmap e24: 5 total, 4 up, 5 in 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:42 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: osdmap e24: 5 total, 4 up, 5 in 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.543 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:42 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:42.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: osdmap e24: 5 total, 4 up, 5 in 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-18T03:25:42.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:42 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:43 trial034 ceph-mon[21825]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:43.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:43 trial034 ceph-mon[21825]: osdmap e25: 5 total, 4 up, 5 in 2026-02-18T03:25:43.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:43 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:43.557 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:43 trial086 ceph-mon[24100]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:43.557 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:43 trial086 ceph-mon[24100]: osdmap e25: 5 total, 4 up, 5 in 2026-02-18T03:25:43.557 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:43 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:43.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:43 trial155 ceph-mon[24719]: Deploying daemon osd.4 on trial086 2026-02-18T03:25:43.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:43 trial155 ceph-mon[24719]: osdmap e25: 5 total, 4 up, 5 in 2026-02-18T03:25:43.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:43 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:44 trial086 ceph-mon[24100]: osdmap e26: 5 total, 4 up, 5 in 2026-02-18T03:25:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:44 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:44 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:44 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:44 trial086 ceph-mon[24100]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:44 trial034 ceph-mon[21825]: osdmap e26: 5 total, 4 up, 5 in 2026-02-18T03:25:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:44 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:44 trial034 ceph-mon[21825]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:44.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:44 trial155 ceph-mon[24719]: osdmap e26: 5 total, 4 up, 5 in 2026-02-18T03:25:44.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:44 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:44.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:44 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:44 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:44.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:44 trial155 ceph-mon[24719]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-18T03:25:46.542 INFO:teuthology.orchestra.run.trial086.stdout:Created osd(s) 4 on host 'trial086' 2026-02-18T03:25:46.582 DEBUG:teuthology.orchestra.run.trial086:osd.4> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.4.service 2026-02-18T03:25:46.584 INFO:tasks.cephadm:Deploying osd.5 on trial155 with /dev/vg_nvme/lv_4... 2026-02-18T03:25:46.584 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-18T03:25:46.703 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:46.860 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:46.861 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.161 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:25:47.177 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial155:vg_nvme/lv_4 --skip-validation 2026-02-18T03:25:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-18T03:25:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-18T03:25:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.294 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:25:47.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: osdmap e27: 5 total, 4 up, 5 in 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:47.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:47.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:47.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:47.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:47 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.160 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-18T03:25:48.160 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: osdmap e27: 5 total, 4 up, 5 in 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:48.161 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:48.162 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.162 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:47 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.162 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:25:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:25:47.875+0000 7fa7c2f1f640 -1 osd.4 0 waiting for initial osdmap 2026-02-18T03:25:48.162 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:25:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:25:47.878+0000 7fa7b9ceb640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:48.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: osdmap e27: 5 total, 4 up, 5 in 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]} : dispatch 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:48.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:48.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:48.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:47 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.187 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:49.187 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_4'] 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: osdmap e28: 5 total, 4 up, 5 in 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/966179357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.188 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"}]': finished 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886] boot 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: osdmap e29: 6 total, 5 up, 6 in 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1599905997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.189 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:49.190 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:49.190 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.190 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:49.190 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:49.190 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_4'] 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: osdmap e28: 5 total, 4 up, 5 in 2026-02-18T03:25:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/966179357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"}]': finished 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886] boot 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: osdmap e29: 6 total, 5 up, 6 in 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1599905997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:49.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_4'] 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial086", "root=default"]}]': finished 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: osdmap e28: 5 total, 4 up, 5 in 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/966179357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f343de0-b850-4c6f-9d0d-f276ad601b9c"}]': finished 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: osd.4 [v2:10.20.193.86:6816/1439961886,v1:10.20.193.86:6817/1439961886] boot 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: osdmap e29: 6 total, 5 up, 6 in 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1599905997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:49.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:50.011 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:50.011 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:50.012 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: Detected new or changed devices on trial086 2026-02-18T03:25:50.012 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial086 to 29381M 2026-02-18T03:25:50.012 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: osdmap e30: 6 total, 5 up, 6 in 2026-02-18T03:25:50.012 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:49 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: Detected new or changed devices on trial086 2026-02-18T03:25:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial086 to 29381M 2026-02-18T03:25:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: osdmap e30: 6 total, 5 up, 6 in 2026-02-18T03:25:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:49 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: Detected new or changed devices on trial086 2026-02-18T03:25:50.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial086 to 29381M 2026-02-18T03:25:50.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: osdmap e30: 6 total, 5 up, 6 in 2026-02-18T03:25:50.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:49 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:50 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:50 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-18T03:25:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:50 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:52.096 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:51 trial155 ceph-mon[24719]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:52.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:51 trial034 ceph-mon[21825]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:51 trial086 ceph-mon[24100]: Deploying daemon osd.5 on trial155 2026-02-18T03:25:53.173 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:52 trial155 ceph-mon[24719]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:53.173 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:53.173 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:52 trial034 ceph-mon[21825]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:52 trial086 ceph-mon[24100]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:54.807 INFO:teuthology.orchestra.run.trial155.stdout:Created osd(s) 5 on host 'trial155' 2026-02-18T03:25:54.848 DEBUG:teuthology.orchestra.run.trial155:osd.5> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.5.service 2026-02-18T03:25:54.850 INFO:tasks.cephadm:Deploying osd.6 on trial155 with /dev/vg_nvme/lv_3... 2026-02-18T03:25:54.850 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-18T03:25:55.009 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:25:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:55 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.463 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:55 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-18T03:25:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:55.914 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:25:55.934 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial155:vg_nvme/lv_3 --skip-validation 2026-02-18T03:25:56.053 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: osdmap e31: 6 total, 5 up, 6 in 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.349 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.350 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:56.350 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.350 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.350 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.350 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:56 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.455 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-18T03:25:56.455 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: osdmap e31: 6 total, 5 up, 6 in 2026-02-18T03:25:56.455 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:56 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.456 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:25:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:25:56.056+0000 7ff9cb0f0640 -1 osd.5 0 waiting for initial osdmap 2026-02-18T03:25:56.457 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:25:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:25:56.059+0000 7ff9c66d8640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:25:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-18T03:25:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: osdmap e31: 6 total, 5 up, 6 in 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:56.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.335 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:57.335 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:25:57.335 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: osdmap e32: 6 total, 5 up, 6 in 2026-02-18T03:25:57.335 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.336 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:25:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: osdmap e32: 6 total, 5 up, 6 in 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:57.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: osdmap e32: 6 total, 5 up, 6 in 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:25:57.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:58.351 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:25:58.351 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_3'] 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: Detected new or changed devices on trial155 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial155 to 88143M 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849] boot 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: osdmap e33: 6 total, 6 up, 6 in 2026-02-18T03:25:58.352 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3360059141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"}]': finished 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: osdmap e34: 7 total, 6 up, 7 in 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4264339926' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:58.353 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:58 trial155 ceph-mon[24719]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:25:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:25:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:25:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_3'] 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: Detected new or changed devices on trial155 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial155 to 88143M 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849] boot 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: osdmap e33: 6 total, 6 up, 6 in 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3360059141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"}]': finished 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: osdmap e34: 7 total, 6 up, 7 in 2026-02-18T03:25:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:58.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/4264339926' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:58.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:58 trial086 ceph-mon[24100]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_3'] 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial155 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: Detected new or changed devices on trial155 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial155 to 88143M 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: osd.5 [v2:10.20.193.155:6800/2036977849,v1:10.20.193.155:6801/2036977849] boot 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: osdmap e33: 6 total, 6 up, 6 in 2026-02-18T03:25:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3360059141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"} : dispatch 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086d2f3d-013a-4321-8d59-ed721774d8f6"}]': finished 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: osdmap e34: 7 total, 6 up, 7 in 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4264339926' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:25:58.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:58 trial034 ceph-mon[21825]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-18T03:25:59.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: osdmap e35: 7 total, 6 up, 7 in 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: Deploying daemon osd.6 on trial155 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:25:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: osdmap e35: 7 total, 6 up, 7 in 2026-02-18T03:25:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: Deploying daemon osd.6 on trial155 2026-02-18T03:25:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:25:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: osdmap e35: 7 total, 6 up, 7 in 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: Deploying daemon osd.6 on trial155 2026-02-18T03:25:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-18T03:25:59.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:25:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:00.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:00 trial034 ceph-mon[21825]: Deploying daemon osd.6 on trial155 2026-02-18T03:26:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:00 trial034 ceph-mon[21825]: osdmap e36: 7 total, 6 up, 7 in 2026-02-18T03:26:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:00 trial034 ceph-mon[21825]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-18T03:26:00.541 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:00 trial155 ceph-mon[24719]: Deploying daemon osd.6 on trial155 2026-02-18T03:26:00.541 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:00 trial155 ceph-mon[24719]: osdmap e36: 7 total, 6 up, 7 in 2026-02-18T03:26:00.541 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:00 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:00.541 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:00 trial155 ceph-mon[24719]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-18T03:26:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:00 trial086 ceph-mon[24100]: Deploying daemon osd.6 on trial155 2026-02-18T03:26:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:00 trial086 ceph-mon[24100]: osdmap e36: 7 total, 6 up, 7 in 2026-02-18T03:26:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:00 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:00 trial086 ceph-mon[24100]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-18T03:26:01.370 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:01 trial155 ceph-mon[24719]: osdmap e37: 7 total, 6 up, 7 in 2026-02-18T03:26:01.370 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:01.370 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:01.371 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:01 trial034 ceph-mon[21825]: osdmap e37: 7 total, 6 up, 7 in 2026-02-18T03:26:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:01 trial086 ceph-mon[24100]: osdmap e37: 7 total, 6 up, 7 in 2026-02-18T03:26:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:02 trial034 ceph-mon[21825]: pgmap v73: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 126 KiB/s, 0 objects/s recovering 2026-02-18T03:26:02.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:02 trial086 ceph-mon[24100]: pgmap v73: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 126 KiB/s, 0 objects/s recovering 2026-02-18T03:26:02.626 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:02 trial155 ceph-mon[24719]: pgmap v73: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 126 KiB/s, 0 objects/s recovering 2026-02-18T03:26:03.708 INFO:teuthology.orchestra.run.trial155.stdout:Created osd(s) 6 on host 'trial155' 2026-02-18T03:26:03.750 DEBUG:teuthology.orchestra.run.trial155:osd.6> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.6.service 2026-02-18T03:26:03.752 INFO:tasks.cephadm:Deploying osd.7 on trial155 with /dev/vg_nvme/lv_2... 2026-02-18T03:26:03.752 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-18T03:26:03.910 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:04.828 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:26:04.843 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch daemon add osd trial155:vg_nvme/lv_2 --skip-validation 2026-02-18T03:26:04.962 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:26:05.215 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:05.215 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-18T03:26:05.215 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: osdmap e38: 7 total, 6 up, 7 in 2026-02-18T03:26:05.215 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:05.215 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:04 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.216 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:26:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:26:04.964+0000 7f5b40a9d640 -1 osd.6 0 waiting for initial osdmap 2026-02-18T03:26:05.217 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:26:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:26:04.967+0000 7f5b3c085640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:26:05.254 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: osdmap e38: 7 total, 6 up, 7 in 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.255 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.256 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.256 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:04 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-18T03:26:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: osdmap e38: 7 total, 6 up, 7 in 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:05.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: osdmap e39: 7 total, 6 up, 7 in 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: osdmap e39: 7 total, 6 up, 7 in 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: osdmap e39: 7 total, 6 up, 7 in 2026-02-18T03:26:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:06.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:05 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:07.223 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:26:07.223 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: osd.default does not exist. Creating it now. 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_2'] 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: Saving service osd.default spec with placement trial155 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: Detected new or changed devices on trial155 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial155 to 44071M 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172] boot 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: osdmap e40: 7 total, 7 up, 7 in 2026-02-18T03:26:07.224 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3505961380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"}]': finished 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: osdmap e41: 8 total, 7 up, 8 in 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:07.225 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3402506534' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:26:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:26:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: osd.default does not exist. Creating it now. 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_2'] 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: Saving service osd.default spec with placement trial155 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: Detected new or changed devices on trial155 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial155 to 44071M 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172] boot 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: osdmap e40: 7 total, 7 up, 7 in 2026-02-18T03:26:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3505961380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"}]': finished 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: osdmap e41: 8 total, 7 up, 8 in 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:07.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3402506534' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial155:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: osd.default does not exist. Creating it now. 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: Creating OSDs with service ID: default on trial155:['vg_nvme/lv_2'] 2026-02-18T03:26:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: Marking host: trial155 for OSDSpec preview refresh. 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: Saving service osd.default spec with placement trial155 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: Detected new or changed devices on trial155 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial155 to 44071M 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: osd.6 [v2:10.20.193.155:6808/3719862172,v1:10.20.193.155:6809/3719862172] boot 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: osdmap e40: 7 total, 7 up, 7 in 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3505961380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"} : dispatch 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b6a80ea-96ac-4eb8-be91-242f4e82e06d"}]': finished 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: osdmap e41: 8 total, 7 up, 8 in 2026-02-18T03:26:07.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:07.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:06 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3402506534' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: osdmap e42: 8 total, 7 up, 8 in 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:08.307 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.308 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: osdmap e42: 8 total, 7 up, 8 in 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: osdmap e42: 8 total, 7 up, 8 in 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-18T03:26:08.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:08 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:09.435 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:09 trial155 ceph-mon[24719]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:09 trial034 ceph-mon[21825]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:09.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:09 trial086 ceph-mon[24100]: Deploying daemon osd.7 on trial155 2026-02-18T03:26:10.989 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:10.989 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:10.989 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:10 trial155 ceph-mon[24719]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:11.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:11.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:11.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:10 trial034 ceph-mon[21825]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:11.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:10 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:11.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:10 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:11.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:10 trial086 ceph-mon[24100]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:12.480 INFO:teuthology.orchestra.run.trial155.stdout:Created osd(s) 7 on host 'trial155' 2026-02-18T03:26:12.519 DEBUG:teuthology.orchestra.run.trial155:osd.7> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.7.service 2026-02-18T03:26:12.522 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-18T03:26:12.522 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:26:12.645 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:12.875 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:12.916 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1771385165,"num_in_osds":8,"osd_in_since":1771385166,"num_remapped_pgs":0} 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:12 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:12 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-18T03:26:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.917 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:26:13.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-18T03:26:13.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: osdmap e43: 8 total, 7 up, 8 in 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/426626505' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:13 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:13.980 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:26:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:26:13.810+0000 7f0d7fd98640 -1 osd.7 0 waiting for initial osdmap 2026-02-18T03:26:13.980 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:26:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:26:13.814+0000 7f0d77378640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T03:26:14.036 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:14.062 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: osdmap e43: 8 total, 7 up, 8 in 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/426626505' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.063 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.064 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.064 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:13 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-18T03:26:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: osdmap e43: 8 total, 7 up, 8 in 2026-02-18T03:26:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]} : dispatch 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/426626505' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:13 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.259 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:14.300 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":44,"num_osds":8,"num_up_osds":7,"osd_up_since":1771385165,"num_in_osds":8,"osd_in_since":1771385166,"num_remapped_pgs":0} 2026-02-18T03:26:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: osdmap e44: 8 total, 7 up, 8 in 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:14.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2274018950' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:14.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: osdmap e44: 8 total, 7 up, 8 in 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2274018950' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:14 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial155", "root=default"]}]': finished 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: osdmap e44: 8 total, 7 up, 8 in 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2274018950' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-18T03:26:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:15.300 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd stat -f json 2026-02-18T03:26:15.420 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:15.643 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:15.682 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1771385174,"num_in_osds":8,"osd_in_since":1771385166,"num_remapped_pgs":0} 2026-02-18T03:26:15.683 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:26:15.801 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: purged_snaps scrub starts 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: Detected new or changed devices on trial155 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial155 to 29381M 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031] boot 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: osdmap e45: 8 total, 8 up, 8 in 2026-02-18T03:26:15.916 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.917 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4133884899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: purged_snaps scrub starts 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: purged_snaps scrub ok 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: Detected new or changed devices on trial155 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: Adjusting osd_memory_target on trial155 to 29381M 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031] boot 2026-02-18T03:26:15.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: osdmap e45: 8 total, 8 up, 8 in 2026-02-18T03:26:15.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:15.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4133884899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:16.037 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:16.038 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":46,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","created":"2026-02-18T03:24:09.561806+0000","modified":"2026-02-18T03:26:15.814594+0000","last_up_change":"2026-02-18T03:26:14.809888+0000","last_in_change":"2026-02-18T03:26:06.177707+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:25:32.017487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ae662f-a3ac-441d-9153-38a88a7bf842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6803","nonce":1922915375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6805","nonce":1922915375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6809","nonce":1922915375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6807","nonce":1922915375}]},"public_addr":"10.20.193.34:6803/1922915375","cluster_addr":"10.20.193.34:6805/1922915375","heartbeat_back_addr":"10.20.193.34:6809/1922915375","heartbeat_front_addr":"10.20.193.34:6807/1922915375","state":["exists","up"]},{"osd":1,"uuid":"3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6811","nonce":93492680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6813","nonce":93492680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6817","nonce":93492680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6815","nonce":93492680}]},"public_addr":"10.20.193.34:6811/93492680","cluster_addr":"10.20.193.34:6813/93492680","heartbeat_back_addr":"10.20.193.34:6817/93492680","heartbeat_front_addr":"10.20.193.34:6815/93492680","state":["exists","up"]},{"osd":2,"uuid":"400d5239-cf11-4fca-8002-3840445a1f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6801","nonce":1601265450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6803","nonce":1601265450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6807","nonce":1601265450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6805","nonce":1601265450}]},"public_addr":"10.20.193.86:6801/1601265450","cluster_addr":"10.20.193.86:6803/1601265450","heartbeat_back_addr":"10.20.193.86:6807/1601265450","heartbeat_front_addr":"10.20.193.86:6805/1601265450","state":["exists","up"]},{"osd":3,"uuid":"ded6c259-415d-461a-a5ce-a00d62bd73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6809","nonce":3991930288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6811","nonce":3991930288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6815","nonce":3991930288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6813","nonce":3991930288}]},"public_addr":"10.20.193.86:6809/3991930288","cluster_addr":"10.20.193.86:6811/3991930288","heartbeat_back_addr":"10.20.193.86:6815/3991930288","heartbeat_front_addr":"10.20.193.86:6813/3991930288","state":["exists","up"]},{"osd":4,"uuid":"54e189d7-b2a5-4897-a57e-592fc1d618e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6817","nonce":1439961886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6819","nonce":1439961886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6823","nonce":1439961886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6821","nonce":1439961886}]},"public_addr":"10.20.193.86:6817/1439961886","cluster_addr":"10.20.193.86:6819/1439961886","heartbeat_back_addr":"10.20.193.86:6823/1439961886","heartbeat_front_addr":"10.20.193.86:6821/1439961886","state":["exists","up"]},{"osd":5,"uuid":"7f343de0-b850-4c6f-9d0d-f276ad601b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6801","nonce":2036977849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6803","nonce":2036977849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6807","nonce":2036977849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6805","nonce":2036977849}]},"public_addr":"10.20.193.155:6801/2036977849","cluster_addr":"10.20.193.155:6803/2036977849","heartbeat_back_addr":"10.20.193.155:6807/2036977849","heartbeat_front_addr":"10.20.193.155:6805/2036977849","state":["exists","up"]},{"osd":6,"uuid":"086d2f3d-013a-4321-8d59-ed721774d8f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6809","nonce":3719862172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6811","nonce":3719862172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6815","nonce":3719862172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6813","nonce":3719862172}]},"public_addr":"10.20.193.155:6809/3719862172","cluster_addr":"10.20.193.155:6811/3719862172","heartbeat_back_addr":"10.20.193.155:6815/3719862172","heartbeat_front_addr":"10.20.193.155:6813/3719862172","state":["exists","up"]},{"osd":7,"uuid":"0b6a80ea-96ac-4eb8-be91-242f4e82e06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6817","nonce":2769531031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6819","nonce":2769531031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6823","nonce":2769531031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6821","nonce":2769531031}]},"public_addr":"10.20.193.155:6817/2769531031","cluster_addr":"10.20.193.155:6819/2769531031","heartbeat_back_addr":"10.20.193.155:6823/2769531031","heartbeat_front_addr":"10.20.193.155:6821/2769531031","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:13.316258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:20.904292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:29.867784+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:38.779069+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:47.515808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:55.784403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:04.673928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:13.422028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.34:0/906322023":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3729483561":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6801/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6800/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/572041124":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/4275685682":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3235393635":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/1369661688":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6801/272188705":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6800/272188705":"2026-02-19T03:24:19.651106+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:26:16.078 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-18T03:25:32.017487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-18T03:26:16.079 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: purged_snaps scrub starts 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: purged_snaps scrub ok 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: Detected new or changed devices on trial155 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: Adjusting osd_memory_target on trial155 to 29381M 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: osd.7 [v2:10.20.193.155:6816/2769531031,v1:10.20.193.155:6817/2769531031] boot 2026-02-18T03:26:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: osdmap e45: 8 total, 8 up, 8 in 2026-02-18T03:26:16.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-18T03:26:16.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:15 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4133884899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-18T03:26:16.212 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:16.436 INFO:teuthology.orchestra.run.trial034.stdout:pg_num: 1 2026-02-18T03:26:16.477 INFO:tasks.cephadm:Setting up client nodes... 2026-02-18T03:26:16.477 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:26:16.615 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:26:16.905 INFO:teuthology.orchestra.run.trial014.stdout:[client.0] 2026-02-18T03:26:16.906 INFO:teuthology.orchestra.run.trial014.stdout: key = AQBYMZVpnUfaNRAA4/AGzEuwVpobL6e3RBwqzw== 2026-02-18T03:26:16.966 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:26:16.967 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-18T03:26:16.967 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-18T03:26:17.036 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: osdmap e46: 8 total, 8 up, 8 in 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2078066807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:16 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/176063334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:26:17.155 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:17.177 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: osdmap e46: 8 total, 8 up, 8 in 2026-02-18T03:26:17.178 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:17.178 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2078066807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:17.178 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.178 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.178 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/176063334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:26:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: osdmap e46: 8 total, 8 up, 8 in 2026-02-18T03:26:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2078066807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:17.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:17.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:16 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/176063334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:26:17.431 INFO:teuthology.orchestra.run.trial034.stdout:[client.1] 2026-02-18T03:26:17.432 INFO:teuthology.orchestra.run.trial034.stdout: key = AQBZMZVp+NKZGRAA9SsM1irRHDfPnlgoIY3Qdg== 2026-02-18T03:26:17.469 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:26:17.469 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-18T03:26:17.469 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-18T03:26:17.505 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:26:17.628 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:26:17.904 INFO:teuthology.orchestra.run.trial086.stdout:[client.2] 2026-02-18T03:26:17.904 INFO:teuthology.orchestra.run.trial086.stdout: key = AQBZMZVpzayyNRAAg7kqftr7FbjqyLi/omYmdw== 2026-02-18T03:26:17.944 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:26:17.944 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2026-02-18T03:26:17.944 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2026-02-18T03:26:17.980 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph auth get-or-create client.3 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:26:18.100 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:26:18.122 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.122 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.122 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.122 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.14:0/2059012404' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2986617275' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:18.368 INFO:teuthology.orchestra.run.trial155.stdout:[client.3] 2026-02-18T03:26:18.368 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBaMZVpUzi6FRAAFcXrVyOpwMh+WZvVPEkyag== 2026-02-18T03:26:18.407 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:26:18.407 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.client.3.keyring 2026-02-18T03:26:18.407 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2026-02-18T03:26:18.444 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph auth get-or-create client.4 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-18T03:26:18.572 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:26:18.850 INFO:teuthology.orchestra.run.trial177.stdout:[client.4] 2026-02-18T03:26:18.851 INFO:teuthology.orchestra.run.trial177.stdout: key = AQBaMZVpF7KDMhAAkf80Vtjc7A3II9xc0+2cCw== 2026-02-18T03:26:18.890 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:26:18.890 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.client.4.keyring 2026-02-18T03:26:18.890 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 0644 /etc/ceph/ceph.client.4.keyring 2026-02-18T03:26:18.989 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-18T03:26:19.109 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2918354698' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3338137702' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:18 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2918354698' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3338137702' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:18 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2918354698' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3338137702' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:19.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:18 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:19.335 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:19.373 INFO:teuthology.orchestra.run.trial034.stdout:[{"version":17,"timestamp":"2026-02-18T03:26:14.252191+0000","name":"","changes":[{"name":"osd/host:trial155/osd_memory_target","previous_value":"46212449484","new_value":"30808299656"}]}] 2026-02-18T03:26:19.373 INFO:tasks.ceph_manager:config epoch is 17 2026-02-18T03:26:19.373 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-18T03:26:19.373 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-18T03:26:19.374 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-18T03:26:19.491 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:19.759 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:19.796 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":14,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":2046970707},{"type":"v1","addr":"10.20.193.34:6801","nonce":2046970707}]},"active_addr":"10.20.193.34:6801/2046970707","active_change":"2026-02-18T03:24:29.806107+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.34:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":2986978090}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":9099893}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":2835716219}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":3555918832}]}]} 2026-02-18T03:26:19.801 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-18T03:26:19.801 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-18T03:26:19.801 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:26:19.918 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1896891069' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:19 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:19 trial034 ceph-mon[21825]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3568171851' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:26:20.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/810893903' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:26:20.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:19 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/1896891069' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:19 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:19 trial086 ceph-mon[24100]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:20.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:19 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3568171851' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:26:20.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:19 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/810893903' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:26:20.150 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:20.150 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":46,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","created":"2026-02-18T03:24:09.561806+0000","modified":"2026-02-18T03:26:15.814594+0000","last_up_change":"2026-02-18T03:26:14.809888+0000","last_in_change":"2026-02-18T03:26:06.177707+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:25:32.017487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ae662f-a3ac-441d-9153-38a88a7bf842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6803","nonce":1922915375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6805","nonce":1922915375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6809","nonce":1922915375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6807","nonce":1922915375}]},"public_addr":"10.20.193.34:6803/1922915375","cluster_addr":"10.20.193.34:6805/1922915375","heartbeat_back_addr":"10.20.193.34:6809/1922915375","heartbeat_front_addr":"10.20.193.34:6807/1922915375","state":["exists","up"]},{"osd":1,"uuid":"3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6811","nonce":93492680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6813","nonce":93492680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6817","nonce":93492680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6815","nonce":93492680}]},"public_addr":"10.20.193.34:6811/93492680","cluster_addr":"10.20.193.34:6813/93492680","heartbeat_back_addr":"10.20.193.34:6817/93492680","heartbeat_front_addr":"10.20.193.34:6815/93492680","state":["exists","up"]},{"osd":2,"uuid":"400d5239-cf11-4fca-8002-3840445a1f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6801","nonce":1601265450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6803","nonce":1601265450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6807","nonce":1601265450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6805","nonce":1601265450}]},"public_addr":"10.20.193.86:6801/1601265450","cluster_addr":"10.20.193.86:6803/1601265450","heartbeat_back_addr":"10.20.193.86:6807/1601265450","heartbeat_front_addr":"10.20.193.86:6805/1601265450","state":["exists","up"]},{"osd":3,"uuid":"ded6c259-415d-461a-a5ce-a00d62bd73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6809","nonce":3991930288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6811","nonce":3991930288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6815","nonce":3991930288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6813","nonce":3991930288}]},"public_addr":"10.20.193.86:6809/3991930288","cluster_addr":"10.20.193.86:6811/3991930288","heartbeat_back_addr":"10.20.193.86:6815/3991930288","heartbeat_front_addr":"10.20.193.86:6813/3991930288","state":["exists","up"]},{"osd":4,"uuid":"54e189d7-b2a5-4897-a57e-592fc1d618e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6817","nonce":1439961886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6819","nonce":1439961886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6823","nonce":1439961886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6821","nonce":1439961886}]},"public_addr":"10.20.193.86:6817/1439961886","cluster_addr":"10.20.193.86:6819/1439961886","heartbeat_back_addr":"10.20.193.86:6823/1439961886","heartbeat_front_addr":"10.20.193.86:6821/1439961886","state":["exists","up"]},{"osd":5,"uuid":"7f343de0-b850-4c6f-9d0d-f276ad601b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6801","nonce":2036977849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6803","nonce":2036977849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6807","nonce":2036977849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6805","nonce":2036977849}]},"public_addr":"10.20.193.155:6801/2036977849","cluster_addr":"10.20.193.155:6803/2036977849","heartbeat_back_addr":"10.20.193.155:6807/2036977849","heartbeat_front_addr":"10.20.193.155:6805/2036977849","state":["exists","up"]},{"osd":6,"uuid":"086d2f3d-013a-4321-8d59-ed721774d8f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6809","nonce":3719862172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6811","nonce":3719862172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6815","nonce":3719862172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6813","nonce":3719862172}]},"public_addr":"10.20.193.155:6809/3719862172","cluster_addr":"10.20.193.155:6811/3719862172","heartbeat_back_addr":"10.20.193.155:6815/3719862172","heartbeat_front_addr":"10.20.193.155:6813/3719862172","state":["exists","up"]},{"osd":7,"uuid":"0b6a80ea-96ac-4eb8-be91-242f4e82e06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6817","nonce":2769531031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6819","nonce":2769531031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6823","nonce":2769531031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6821","nonce":2769531031}]},"public_addr":"10.20.193.155:6817/2769531031","cluster_addr":"10.20.193.155:6819/2769531031","heartbeat_back_addr":"10.20.193.155:6823/2769531031","heartbeat_front_addr":"10.20.193.155:6821/2769531031","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:13.316258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:20.904292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:29.867784+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:38.779069+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:47.515808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:55.784403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:04.673928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:13.422028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.34:0/906322023":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3729483561":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6801/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6800/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/572041124":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/4275685682":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3235393635":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/1369661688":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6801/272188705":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6800/272188705":"2026-02-19T03:24:19.651106+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:26:20.187 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-18T03:26:20.188 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd dump --format=json 2026-02-18T03:26:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:19 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1896891069' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:19 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-18T03:26:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:19 trial155 ceph-mon[24719]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.4", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-18T03:26:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:19 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3568171851' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-18T03:26:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:19 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/810893903' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-18T03:26:20.308 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.532 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:20.532 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":46,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","created":"2026-02-18T03:24:09.561806+0000","modified":"2026-02-18T03:26:15.814594+0000","last_up_change":"2026-02-18T03:26:14.809888+0000","last_in_change":"2026-02-18T03:26:06.177707+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:25:32.017487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ae662f-a3ac-441d-9153-38a88a7bf842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6803","nonce":1922915375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6805","nonce":1922915375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6809","nonce":1922915375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6807","nonce":1922915375}]},"public_addr":"10.20.193.34:6803/1922915375","cluster_addr":"10.20.193.34:6805/1922915375","heartbeat_back_addr":"10.20.193.34:6809/1922915375","heartbeat_front_addr":"10.20.193.34:6807/1922915375","state":["exists","up"]},{"osd":1,"uuid":"3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6811","nonce":93492680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6813","nonce":93492680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6817","nonce":93492680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6815","nonce":93492680}]},"public_addr":"10.20.193.34:6811/93492680","cluster_addr":"10.20.193.34:6813/93492680","heartbeat_back_addr":"10.20.193.34:6817/93492680","heartbeat_front_addr":"10.20.193.34:6815/93492680","state":["exists","up"]},{"osd":2,"uuid":"400d5239-cf11-4fca-8002-3840445a1f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6801","nonce":1601265450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6803","nonce":1601265450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6807","nonce":1601265450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6805","nonce":1601265450}]},"public_addr":"10.20.193.86:6801/1601265450","cluster_addr":"10.20.193.86:6803/1601265450","heartbeat_back_addr":"10.20.193.86:6807/1601265450","heartbeat_front_addr":"10.20.193.86:6805/1601265450","state":["exists","up"]},{"osd":3,"uuid":"ded6c259-415d-461a-a5ce-a00d62bd73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6809","nonce":3991930288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6811","nonce":3991930288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6815","nonce":3991930288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6813","nonce":3991930288}]},"public_addr":"10.20.193.86:6809/3991930288","cluster_addr":"10.20.193.86:6811/3991930288","heartbeat_back_addr":"10.20.193.86:6815/3991930288","heartbeat_front_addr":"10.20.193.86:6813/3991930288","state":["exists","up"]},{"osd":4,"uuid":"54e189d7-b2a5-4897-a57e-592fc1d618e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6817","nonce":1439961886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6819","nonce":1439961886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6823","nonce":1439961886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6821","nonce":1439961886}]},"public_addr":"10.20.193.86:6817/1439961886","cluster_addr":"10.20.193.86:6819/1439961886","heartbeat_back_addr":"10.20.193.86:6823/1439961886","heartbeat_front_addr":"10.20.193.86:6821/1439961886","state":["exists","up"]},{"osd":5,"uuid":"7f343de0-b850-4c6f-9d0d-f276ad601b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6801","nonce":2036977849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6803","nonce":2036977849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6807","nonce":2036977849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6805","nonce":2036977849}]},"public_addr":"10.20.193.155:6801/2036977849","cluster_addr":"10.20.193.155:6803/2036977849","heartbeat_back_addr":"10.20.193.155:6807/2036977849","heartbeat_front_addr":"10.20.193.155:6805/2036977849","state":["exists","up"]},{"osd":6,"uuid":"086d2f3d-013a-4321-8d59-ed721774d8f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6809","nonce":3719862172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6811","nonce":3719862172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6815","nonce":3719862172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6813","nonce":3719862172}]},"public_addr":"10.20.193.155:6809/3719862172","cluster_addr":"10.20.193.155:6811/3719862172","heartbeat_back_addr":"10.20.193.155:6815/3719862172","heartbeat_front_addr":"10.20.193.155:6813/3719862172","state":["exists","up"]},{"osd":7,"uuid":"0b6a80ea-96ac-4eb8-be91-242f4e82e06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6817","nonce":2769531031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6819","nonce":2769531031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6823","nonce":2769531031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6821","nonce":2769531031}]},"public_addr":"10.20.193.155:6817/2769531031","cluster_addr":"10.20.193.155:6819/2769531031","heartbeat_back_addr":"10.20.193.155:6823/2769531031","heartbeat_front_addr":"10.20.193.155:6821/2769531031","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:13.316258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:20.904292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:29.867784+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:38.779069+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:47.515808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:55.784403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:04.673928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:13.422028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.34:0/906322023":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3729483561":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6801/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6800/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/572041124":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/4275685682":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3235393635":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/1369661688":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6801/272188705":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6800/272188705":"2026-02-19T03:24:19.651106+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:26:20.586 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-18T03:26:20.587 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-18T03:26:20.587 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-18T03:26:20.591 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-18T03:26:20.592 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-18T03:26:20.592 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-18T03:26:20.593 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-18T03:26:20.593 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-18T03:26:20.725 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.725 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.726 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.731 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.755 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.756 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.757 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.803 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:20.854 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:20 trial034 ceph-mon[21825]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:20.854 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3916859813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:20.854 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/103954054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:20.935 INFO:teuthology.orchestra.run.trial034.stdout:141733920775 2026-02-18T03:26:20.935 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-18T03:26:20.965 INFO:teuthology.orchestra.run.trial034.stdout:124554051593 2026-02-18T03:26:20.966 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-18T03:26:20.967 INFO:teuthology.orchestra.run.trial034.stdout:64424509453 2026-02-18T03:26:20.968 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-18T03:26:20.969 INFO:teuthology.orchestra.run.trial034.stdout:34359738385 2026-02-18T03:26:20.969 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-18T03:26:20.977 INFO:teuthology.orchestra.run.trial034.stdout:51539607566 2026-02-18T03:26:20.978 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-18T03:26:20.989 INFO:teuthology.orchestra.run.trial034.stdout:193273528325 2026-02-18T03:26:20.989 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-18T03:26:20.993 INFO:teuthology.orchestra.run.trial034.stdout:171798691846 2026-02-18T03:26:20.994 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-18T03:26:21.009 INFO:teuthology.orchestra.run.trial034.stdout:94489280523 2026-02-18T03:26:21.010 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-18T03:26:21.064 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.099 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.111 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.111 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.117 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:20 trial086 ceph-mon[24100]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:21.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:20 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3916859813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:21.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:20 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/103954054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:21.136 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.180 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.181 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:20 trial155 ceph-mon[24719]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:20 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3916859813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:20 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/103954054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:26:21.323 INFO:teuthology.orchestra.run.trial034.stdout:141733920774 2026-02-18T03:26:21.363 INFO:teuthology.orchestra.run.trial034.stdout:64424509452 2026-02-18T03:26:21.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920775 got 141733920774 for osd.5 2026-02-18T03:26:21.372 INFO:teuthology.orchestra.run.trial034.stdout:124554051592 2026-02-18T03:26:21.377 INFO:teuthology.orchestra.run.trial034.stdout:34359738383 2026-02-18T03:26:21.383 INFO:teuthology.orchestra.run.trial034.stdout:51539607565 2026-02-18T03:26:21.386 INFO:teuthology.orchestra.run.trial034.stdout:193273528323 2026-02-18T03:26:21.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.2 2026-02-18T03:26:21.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051593 got 124554051592 for osd.4 2026-02-18T03:26:21.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607566 got 51539607565 for osd.1 2026-02-18T03:26:21.433 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528325 got 193273528323 for osd.7 2026-02-18T03:26:21.437 INFO:teuthology.orchestra.run.trial034.stdout:94489280521 2026-02-18T03:26:21.440 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738385 got 34359738383 for osd.0 2026-02-18T03:26:21.442 INFO:teuthology.orchestra.run.trial034.stdout:171798691845 2026-02-18T03:26:21.477 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280523 got 94489280521 for osd.3 2026-02-18T03:26:21.481 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691846 got 171798691845 for osd.6 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/530155419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1829624332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1474919763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4058148373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1184245242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:22.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2878915807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:22.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1503635391' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:22.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:21 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3570192760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/530155419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1829624332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1474919763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4058148373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1184245242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2878915807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:22.166 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1503635391' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:22.167 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3570192760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/530155419' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1829624332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1474919763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4058148373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1184245242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2878915807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:22.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1503635391' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:22.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3570192760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:22.368 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-18T03:26:22.411 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-18T03:26:22.421 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-18T03:26:22.433 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-18T03:26:22.434 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-18T03:26:22.441 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-18T03:26:22.478 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-18T03:26:22.482 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-18T03:26:22.487 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.531 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.581 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.582 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.582 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.583 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.621 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.623 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:22.760 INFO:teuthology.orchestra.run.trial034.stdout:141733920775 2026-02-18T03:26:22.770 INFO:teuthology.orchestra.run.trial034.stdout:64424509453 2026-02-18T03:26:22.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920775 got 141733920775 for osd.5 2026-02-18T03:26:22.805 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.815 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.2 2026-02-18T03:26:22.815 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.847 INFO:teuthology.orchestra.run.trial034.stdout:193273528325 2026-02-18T03:26:22.853 INFO:teuthology.orchestra.run.trial034.stdout:51539607566 2026-02-18T03:26:22.859 INFO:teuthology.orchestra.run.trial034.stdout:34359738385 2026-02-18T03:26:22.859 INFO:teuthology.orchestra.run.trial034.stdout:124554051593 2026-02-18T03:26:22.865 INFO:teuthology.orchestra.run.trial034.stdout:94489280523 2026-02-18T03:26:22.872 INFO:teuthology.orchestra.run.trial034.stdout:171798691846 2026-02-18T03:26:22.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528325 got 193273528325 for osd.7 2026-02-18T03:26:22.893 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738385 got 34359738385 for osd.0 2026-02-18T03:26:22.906 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691846 got 171798691846 for osd.6 2026-02-18T03:26:22.933 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051593 got 124554051593 for osd.4 2026-02-18T03:26:22.941 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.942 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280523 got 94489280523 for osd.3 2026-02-18T03:26:22.943 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.951 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:22 trial034 ceph-mon[21825]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2870201498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/837239678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2648304571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:22.952 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/952016751' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:22.953 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607566 got 51539607566 for osd.1 2026-02-18T03:26:22.953 DEBUG:teuthology.parallel:result is None 2026-02-18T03:26:22.954 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-18T03:26:22.954 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph pg dump --format=json 2026-02-18T03:26:23.110 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:23.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:22 trial086 ceph-mon[24100]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:23.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2870201498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:23.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/837239678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:23.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2648304571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:23.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/952016751' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:22 trial155 ceph-mon[24719]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2870201498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-18T03:26:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/837239678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-18T03:26:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2648304571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-18T03:26:23.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/952016751' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-18T03:26:23.331 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:23.331 INFO:teuthology.orchestra.run.trial034.stderr:dumped all 2026-02-18T03:26:23.370 INFO:teuthology.orchestra.run.trial034.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-18T03:26:21.822802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":220940,"kb_used_data":5228,"kb_used_omap":117,"kb_used_meta":215434,"kb_avail":5871804660,"statfs":{"total":6012954214400,"available":6012727971840,"internally_reserved":0,"allocated":5353472,"data_stored":3246600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":120384,"internal_metadata":220604864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001163"},"pg_stats":[{"pgid":"1.0","version":"18'132","reported_seq":239,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-18T03:26:16.047669+0000","last_change":"2026-02-18T03:26:00.249543+0000","last_active":"2026-02-18T03:26:16.047669+0000","last_peered":"2026-02-18T03:26:16.047669+0000","last_clean":"2026-02-18T03:26:16.047669+0000","last_became_active":"2026-02-18T03:26:00.249296+0000","last_became_peered":"2026-02-18T03:26:00.249296+0000","last_unstale":"2026-02-18T03:26:16.047669+0000","last_undegraded":"2026-02-18T03:26:16.047669+0000","last_fullsized":"2026-02-18T03:26:16.047669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_clean_scrub_stamp":"2026-02-18T03:25:32.324385+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:38:55.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":45,"seq":193273528325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":27585142},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691846,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920775,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9437,"internal_metadata":27581219},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18549,"internal_metadata":27572107},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21805,"internal_metadata":27568851},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607566,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":27573407},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27665,"internal_metadata":27562991},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T03:26:23.372 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph pg dump --format=json 2026-02-18T03:26:23.486 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:23.704 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:23.705 INFO:teuthology.orchestra.run.trial034.stderr:dumped all 2026-02-18T03:26:23.741 INFO:teuthology.orchestra.run.trial034.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-18T03:26:21.822802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":220940,"kb_used_data":5228,"kb_used_omap":117,"kb_used_meta":215434,"kb_avail":5871804660,"statfs":{"total":6012954214400,"available":6012727971840,"internally_reserved":0,"allocated":5353472,"data_stored":3246600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":120384,"internal_metadata":220604864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001163"},"pg_stats":[{"pgid":"1.0","version":"18'132","reported_seq":239,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-18T03:26:16.047669+0000","last_change":"2026-02-18T03:26:00.249543+0000","last_active":"2026-02-18T03:26:16.047669+0000","last_peered":"2026-02-18T03:26:16.047669+0000","last_clean":"2026-02-18T03:26:16.047669+0000","last_became_active":"2026-02-18T03:26:00.249296+0000","last_became_peered":"2026-02-18T03:26:00.249296+0000","last_unstale":"2026-02-18T03:26:16.047669+0000","last_undegraded":"2026-02-18T03:26:16.047669+0000","last_fullsized":"2026-02-18T03:26:16.047669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_clean_scrub_stamp":"2026-02-18T03:25:32.324385+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:38:55.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":45,"seq":193273528325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":27585142},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691846,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920775,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9437,"internal_metadata":27581219},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18549,"internal_metadata":27572107},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1016,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1040384,"data_stored":774805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21805,"internal_metadata":27568851},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607566,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":27573407},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27400,"kb_used_data":436,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975800,"statfs":{"total":751619276800,"available":751591219200,"internally_reserved":0,"allocated":446464,"data_stored":184437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27665,"internal_metadata":27562991},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T03:26:23.742 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-18T03:26:23.742 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-18T03:26:23.743 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-18T03:26:23.743 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph health --format=json 2026-02-18T03:26:23.862 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:24.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2761471726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:24.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1308225111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:24.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1386889664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:24.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/116090003' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:24.120 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:24.120 INFO:teuthology.orchestra.run.trial034.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-18T03:26:24.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2761471726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:24.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1308225111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:24.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1386889664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:24.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/116090003' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:24.159 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-18T03:26:24.160 INFO:tasks.cephadm:Setup complete, yielding 2026-02-18T03:26:24.160 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-18T03:26:24.171 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial034.front.sepia.ceph.com 2026-02-18T03:26:24.171 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-18T03:26:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2761471726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-18T03:26:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1308225111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-18T03:26:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1386889664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-18T03:26:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/116090003' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-18T03:26:24.289 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:24.525 INFO:teuthology.orchestra.run.trial034.stdout:Backend: cephadm 2026-02-18T03:26:24.526 INFO:teuthology.orchestra.run.trial034.stdout:Available: Yes 2026-02-18T03:26:24.526 INFO:teuthology.orchestra.run.trial034.stdout:Paused: No 2026-02-18T03:26:24.565 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-18T03:26:24.682 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:mgr.x trial034 *:9283,8765 running (2m) 62s ago 2m 611M - 20.2.0-670-gadc19233 c2bc6184fe25 33dfe098994d 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:mon.a trial034 running (2m) 62s ago 2m 110M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 997bd3a5587b 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:mon.b trial086 running (95s) 11s ago 95s 112M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 b72580359e58 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:mon.c trial155 running (96s) 11s ago 96s 111M 2048M 20.2.0-670-gadc19233 c2bc6184fe25 88741c5c788f 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:osd.0 trial034 running (73s) 62s ago 75s 97.7M 41.0G 20.2.0-670-gadc19233 c2bc6184fe25 54d63f73c831 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:osd.1 trial034 running (65s) 62s ago 65s 99.6M 41.0G 20.2.0-670-gadc19233 c2bc6184fe25 e8f52ac3670f 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:osd.2 trial086 running (56s) 11s ago 58s 109M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 9eb9d6eabc00 2026-02-18T03:26:24.921 INFO:teuthology.orchestra.run.trial034.stdout:osd.3 trial086 running (47s) 11s ago 50s 109M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 a666da01380e 2026-02-18T03:26:24.922 INFO:teuthology.orchestra.run.trial034.stdout:osd.4 trial086 running (39s) 11s ago 41s 104M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 1a8d55bcdff9 2026-02-18T03:26:24.922 INFO:teuthology.orchestra.run.trial034.stdout:osd.5 trial155 running (30s) 11s ago 33s 103M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 e6abc9d932f6 2026-02-18T03:26:24.922 INFO:teuthology.orchestra.run.trial034.stdout:osd.6 trial155 running (22s) 11s ago 24s 100M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 e8f6973a18eb 2026-02-18T03:26:24.922 INFO:teuthology.orchestra.run.trial034.stdout:osd.7 trial155 running (13s) 11s ago 15s 96.3M 28.6G 20.2.0-670-gadc19233 c2bc6184fe25 038dc718072e 2026-02-18T03:26:24.931 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:24 trial034 ceph-mon[21825]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:24.931 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:24 trial034 ceph-mon[21825]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:24.931 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:24 trial034 ceph-mon[21825]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:24.931 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4054049245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:26:24.963 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-18T03:26:25.079 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:25.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:24 trial086 ceph-mon[24100]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:25.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:24 trial086 ceph-mon[24100]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:25.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:24 trial086 ceph-mon[24100]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:25.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:24 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4054049245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:26:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:24 trial155 ceph-mon[24719]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:24 trial155 ceph-mon[24719]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:24 trial155 ceph-mon[24719]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:24 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4054049245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-18T03:26:25.315 INFO:teuthology.orchestra.run.trial034.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:26:25.315 INFO:teuthology.orchestra.run.trial034.stdout:trial014 10.20.193.14 2026-02-18T03:26:25.315 INFO:teuthology.orchestra.run.trial034.stdout:trial034 10.20.193.34 2026-02-18T03:26:25.315 INFO:teuthology.orchestra.run.trial034.stdout:trial086 10.20.193.86 2026-02-18T03:26:25.316 INFO:teuthology.orchestra.run.trial034.stdout:trial155 10.20.193.155 2026-02-18T03:26:25.316 INFO:teuthology.orchestra.run.trial034.stdout:trial177 10.20.193.177 2026-02-18T03:26:25.316 INFO:teuthology.orchestra.run.trial034.stdout:5 hosts in cluster 2026-02-18T03:26:25.354 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-18T03:26:25.472 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:25.699 INFO:teuthology.orchestra.run.trial034.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-18T03:26:25.699 INFO:teuthology.orchestra.run.trial034.stdout:trial014 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47B1C 1788G No 106s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.699 INFO:teuthology.orchestra.run.trial034.stdout:trial014 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00421 1788G No 106s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.699 INFO:teuthology.orchestra.run.trial034.stdout:trial034 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6B84 1788G No 62s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.699 INFO:teuthology.orchestra.run.trial034.stdout:trial034 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6C13 1788G No 62s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial086 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00423 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial086 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0021F 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial155 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6940 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial155 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6947 1788G No 11s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial177 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0040C 1788G No 99s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.700 INFO:teuthology.orchestra.run.trial034.stdout:trial177 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B003F2 1788G No 99s ago Has a FileSystem, LVM detected 2026-02-18T03:26:25.738 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- bash -c 'ceph osd lspools' 2026-02-18T03:26:25.856 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:26.079 INFO:teuthology.orchestra.run.trial034.stdout:1 .mgr 2026-02-18T03:26:26.118 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:25 trial034 ceph-mon[21825]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.118 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:25 trial034 ceph-mon[21825]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.120 INFO:teuthology.run_tasks:Running task nvmeof... 2026-02-18T03:26:26.151 INFO:tasks.nvmeof:[nvmeof]: deploying nvmeof gateway... 2026-02-18T03:26:26.151 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.a on trial034 2026-02-18T03:26:26.151 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.b on trial086 2026-02-18T03:26:26.152 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.c on trial155 2026-02-18T03:26:26.152 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.d on trial177 2026-02-18T03:26:26.152 INFO:tasks.nvmeof:[nvmeof]: ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:devel 2026-02-18T03:26:26.152 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:devel 2026-02-18T03:26:26.153 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:25 trial086 ceph-mon[24100]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.154 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:25 trial086 ceph-mon[24100]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:25 trial155 ceph-mon[24719]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:25 trial155 ceph-mon[24719]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.269 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:26.552 INFO:tasks.nvmeof:[nvmeof]: ceph osd pool create mypool 2026-02-18T03:26:26.553 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph osd pool create mypool 2026-02-18T03:26:26.667 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2925211295' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:26:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1230018222' entity='client.admin' 2026-02-18T03:26:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:27.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:27.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2925211295' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:26:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1230018222' entity='client.admin' 2026-02-18T03:26:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2925211295' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1230018222' entity='client.admin' 2026-02-18T03:26:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:26 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:27.868 INFO:teuthology.orchestra.run.trial034.stderr:pool 'mypool' created 2026-02-18T03:26:27.909 INFO:tasks.nvmeof:[nvmeof]: rbd pool init mypool 2026-02-18T03:26:27.909 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- rbd pool init mypool 2026-02-18T03:26:28.026 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:28.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:28.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:27 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:28.141 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:26:28.141 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.141 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.141 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.141 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.142 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:28.142 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:28.142 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.142 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:28 trial086 ceph-mon[24100]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:28 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:26:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:28 trial086 ceph-mon[24100]: osdmap e47: 8 total, 8 up, 8 in 2026-02-18T03:26:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:28 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:26:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:28 trial155 ceph-mon[24719]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:26:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:28 trial155 ceph-mon[24719]: osdmap e47: 8 total, 8 up, 8 in 2026-02-18T03:26:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:26:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:28 trial034 ceph-mon[21825]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/540051534' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2026-02-18T03:26:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:28 trial034 ceph-mon[21825]: osdmap e47: 8 total, 8 up, 8 in 2026-02-18T03:26:29.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2026-02-18T03:26:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:26:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:29 trial155 ceph-mon[24719]: osdmap e48: 8 total, 8 up, 8 in 2026-02-18T03:26:30.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:26:30.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:29 trial034 ceph-mon[21825]: osdmap e48: 8 total, 8 up, 8 in 2026-02-18T03:26:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:29 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/951184712' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2026-02-18T03:26:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:29 trial086 ceph-mon[24100]: osdmap e48: 8 total, 8 up, 8 in 2026-02-18T03:26:30.916 INFO:tasks.nvmeof:[nvmeof]: ceph orch apply nvmeof mypool mygroup0 2026-02-18T03:26:30.916 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch apply nvmeof mypool mygroup0 --placement 'trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d' 2026-02-18T03:26:31.033 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:31.148 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:30 trial034 ceph-mon[21825]: pgmap v98: 33 pgs: 4 creating+peering, 25 unknown, 4 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:31.148 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:30 trial034 ceph-mon[21825]: osdmap e49: 8 total, 8 up, 8 in 2026-02-18T03:26:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:30 trial155 ceph-mon[24719]: pgmap v98: 33 pgs: 4 creating+peering, 25 unknown, 4 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:30 trial155 ceph-mon[24719]: osdmap e49: 8 total, 8 up, 8 in 2026-02-18T03:26:31.282 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled nvmeof.mypool.mygroup0 update... 2026-02-18T03:26:31.322 INFO:tasks.nvmeof:[nvmeof]: creating 64 images 2026-02-18T03:26:31.323 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- rbd create mypool/myimage1 --size 8192 ; rbd create mypool/myimage2 --size 8192 ; rbd create mypool/myimage3 --size 8192 ; rbd create mypool/myimage4 --size 8192 ; rbd create mypool/myimage5 --size 8192 ; rbd create mypool/myimage6 --size 8192 ; rbd create mypool/myimage7 --size 8192 ; rbd create mypool/myimage8 --size 8192 ; rbd create mypool/myimage9 --size 8192 ; rbd create mypool/myimage10 --size 8192 ; rbd create mypool/myimage11 --size 8192 ; rbd create mypool/myimage12 --size 8192 ; rbd create mypool/myimage13 --size 8192 ; rbd create mypool/myimage14 --size 8192 ; rbd create mypool/myimage15 --size 8192 ; rbd create mypool/myimage16 --size 8192 ; rbd create mypool/myimage17 --size 8192 ; rbd create mypool/myimage18 --size 8192 ; rbd create mypool/myimage19 --size 8192 ; rbd create mypool/myimage20 --size 8192 ; rbd create mypool/myimage21 --size 8192 ; rbd create mypool/myimage22 --size 8192 ; rbd create mypool/myimage23 --size 8192 ; rbd create mypool/myimage24 --size 8192 ; rbd create mypool/myimage25 --size 8192 ; rbd create mypool/myimage26 --size 8192 ; rbd create mypool/myimage27 --size 8192 ; rbd create mypool/myimage28 --size 8192 ; rbd create mypool/myimage29 --size 8192 ; rbd create mypool/myimage30 --size 8192 ; rbd create mypool/myimage31 --size 8192 ; rbd create mypool/myimage32 --size 8192 ; rbd create mypool/myimage33 --size 8192 ; rbd create mypool/myimage34 --size 8192 ; rbd create mypool/myimage35 --size 8192 ; rbd create mypool/myimage36 --size 8192 ; rbd create mypool/myimage37 --size 8192 ; rbd create mypool/myimage38 --size 8192 ; rbd create mypool/myimage39 --size 8192 ; rbd create mypool/myimage40 --size 8192 ; rbd create mypool/myimage41 --size 8192 ; rbd create mypool/myimage42 --size 8192 ; rbd create mypool/myimage43 --size 8192 ; rbd create mypool/myimage44 --size 8192 ; rbd create mypool/myimage45 --size 8192 ; rbd create mypool/myimage46 --size 8192 ; rbd create mypool/myimage47 --size 8192 ; rbd create mypool/myimage48 --size 8192 ; rbd create mypool/myimage49 --size 8192 ; rbd create mypool/myimage50 --size 8192 ; rbd create mypool/myimage51 --size 8192 ; rbd create mypool/myimage52 --size 8192 ; rbd create mypool/myimage53 --size 8192 ; rbd create mypool/myimage54 --size 8192 ; rbd create mypool/myimage55 --size 8192 ; rbd create mypool/myimage56 --size 8192 ; rbd create mypool/myimage57 --size 8192 ; rbd create mypool/myimage58 --size 8192 ; rbd create mypool/myimage59 --size 8192 ; rbd create mypool/myimage60 --size 8192 ; rbd create mypool/myimage61 --size 8192 ; rbd create mypool/myimage62 --size 8192 ; rbd create mypool/myimage63 --size 8192 ; rbd create mypool/myimage64 --size 8192 ; 2026-02-18T03:26:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:30 trial086 ceph-mon[24100]: pgmap v98: 33 pgs: 4 creating+peering, 25 unknown, 4 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:30 trial086 ceph-mon[24100]: osdmap e49: 8 total, 8 up, 8 in 2026-02-18T03:26:31.441 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:32.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:31 trial155 ceph-mon[24719]: osdmap e50: 8 total, 8 up, 8 in 2026-02-18T03:26:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:31 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:31 trial034 ceph-mon[21825]: osdmap e50: 8 total, 8 up, 8 in 2026-02-18T03:26:32.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:32.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:31 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:31 trial086 ceph-mon[24100]: osdmap e50: 8 total, 8 up, 8 in 2026-02-18T03:26:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:31 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: Saving service nvmeof.mypool.mygroup0 spec with placement trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: pgmap v101: 33 pgs: 4 creating+peering, 11 unknown, 18 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:33.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:32 trial155 ceph-mon[24719]: mgrmap e15: x(active, since 2m) 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: Saving service nvmeof.mypool.mygroup0 spec with placement trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: pgmap v101: 33 pgs: 4 creating+peering, 11 unknown, 18 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.241 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.242 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:32 trial086 ceph-mon[24100]: mgrmap e15: x(active, since 2m) 2026-02-18T03:26:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "group": "mygroup0", "placement": "trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: Saving service nvmeof.mypool.mygroup0 spec with placement trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: pgmap v101: 33 pgs: 4 creating+peering, 11 unknown, 18 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:33.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:32 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 2m) 2026-02-18T03:26:33.400 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:26:33.515 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:33.784 DEBUG:teuthology.orchestra.run.trial034:nvmeof.nvmeof.a> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:26:33.787 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:26:33.910 INFO:teuthology.orchestra.run.trial086.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.b/config 2026-02-18T03:26:34.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:33 trial034 ceph-mon[21825]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:33 trial034 ceph-mon[21825]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:33 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:26:34.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:33 trial086 ceph-mon[24100]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:33 trial086 ceph-mon[24100]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:33 trial086 ceph-mon[24100]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:26:34.214 DEBUG:teuthology.orchestra.run.trial086:nvmeof.nvmeof.b> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:26:34.217 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:26:34.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:33 trial155 ceph-mon[24719]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:33 trial155 ceph-mon[24719]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:26:34.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:33 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:26:34.339 INFO:teuthology.orchestra.run.trial155.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.c/config 2026-02-18T03:26:34.613 DEBUG:teuthology.orchestra.run.trial155:nvmeof.nvmeof.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:26:34.656 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls nvmeof --export > /etc/ceph/nvmeof-gw.yaml 2026-02-18T03:26:34.775 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:26:35.051 DEBUG:teuthology.orchestra.run.trial177:nvmeof.nvmeof.d> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:26:35.054 INFO:tasks.nvmeof:[nvmeof]: executed deploy_nvmeof successfully! 2026-02-18T03:26:35.054 INFO:tasks.nvmeof:[nvmeof]: running set_gateway_cfg... 2026-02-18T03:26:35.055 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:26:35.055 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:26:35.083 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-18T03:26:35.083 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:26:35.108 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-18T03:26:35.108 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:26:35.137 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-18T03:26:35.137 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:26:35.161 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:34 trial155 ceph-mon[24719]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:35.161 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:34 trial155 ceph-mon[24719]: pgmap v102: 33 pgs: 33 active+clean; 583 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 3.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2026-02-18T03:26:35.164 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-18T03:26:35.164 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/nvmeof.env 2026-02-18T03:26:35.190 INFO:tasks.nvmeof:[nvmeof]: executed set_gateway_cfg successfully! 2026-02-18T03:26:35.191 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2026-02-18T03:26:35.206 INFO:tasks.cephadm:Waiting for ceph service nvmeof.mypool.mygroup0 to start (timeout 300)... 2026-02-18T03:26:35.206 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:35.228 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:34 trial034 ceph-mon[21825]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:35.228 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:34 trial034 ceph-mon[21825]: pgmap v102: 33 pgs: 33 active+clean; 583 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 3.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2026-02-18T03:26:35.322 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:34 trial086 ceph-mon[24100]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:34 trial086 ceph-mon[24100]: pgmap v102: 33 pgs: 33 active+clean; 583 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 3.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2026-02-18T03:26:35.556 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:35.557 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:31.281263Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:35.594 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:35 trial155 ceph-mon[24719]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:35 trial155 ceph-mon[24719]: from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:35 trial155 ceph-mon[24719]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:35 trial034 ceph-mon[21825]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:35 trial034 ceph-mon[21825]: from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:35 trial034 ceph-mon[21825]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:35 trial086 ceph-mon[24100]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:35 trial086 ceph-mon[24100]: from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:35 trial086 ceph-mon[24100]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "nvmeof", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:26:36.595 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:36.713 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:36.944 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:36.944 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:31.281263Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:36.983 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:36 trial155 ceph-mon[24719]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:36 trial155 ceph-mon[24719]: pgmap v103: 33 pgs: 33 active+clean; 606 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 97 op/s 2026-02-18T03:26:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:36 trial034 ceph-mon[21825]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:37.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:36 trial034 ceph-mon[21825]: pgmap v103: 33 pgs: 33 active+clean; 606 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 97 op/s 2026-02-18T03:26:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:36 trial086 ceph-mon[24100]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:36 trial086 ceph-mon[24100]: pgmap v103: 33 pgs: 33 active+clean; 606 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 97 op/s 2026-02-18T03:26:37.984 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:38.101 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:38.147 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:37 trial034 ceph-mon[21825]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:38.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:37 trial155 ceph-mon[24719]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:38.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:37 trial086 ceph-mon[24100]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:38.336 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:38.336 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:31.281263Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:38.375 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:38.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 bash[50525]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:26:38.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 bash[50525]: Writing manifest to image destination 2026-02-18T03:26:38.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 podman[50525]: 2026-02-18 03:26:38.556574927 +0000 UTC m=+5.594935252 container create 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.branch=devel, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, architecture=x86_64, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.spdk.version=25.09, io.spdk.build.ceph-release=20.2.0, summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.ceph.nvmeof=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, maintainer=Ceph Developers , io.ceph.version=1.6.5, release=, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 podman[50525]: 2026-02-18 03:26:38.549689051 +0000 UTC m=+5.588049376 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 podman[50525]: 2026-02-18 03:26:38.588471575 +0000 UTC m=+5.626831920 container init 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, io.spdk.build.ceph-release=20.2.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-type=git, io.ceph.version=1.6.5, name=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.openshift.wants=ceph,rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.version=25.09, io.spdk.git.branch=undefined, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., version=1.6.5, io.spdk.build.target-arch=x86-64-v2, release=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.ceph.component=ceph-nvmeof, distribution-scope=public, io.spdk.build.makeflags=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, architecture=x86_64, org.centos.version=9.0-30.el9, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 podman[50525]: 2026-02-18 03:26:38.590688568 +0000 UTC m=+5.629048903 container start 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, distribution-scope=public, io.ceph.component=ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.version=1.6.5, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.branch=undefined, architecture=x86_64, org.centos.version=9.0-30.el9, release=, io.spdk.version=25.09, io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, maintainer=Ceph Developers , io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, version=1.6.5) 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 bash[50525]: 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 systemd[1]: Started Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:26:38.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:26:38.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [gateway] 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): port = 5500 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:26:38.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:26:38.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:26:38.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:26:38.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): force_tls = False 2026-02-18T03:26:38.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:26:38.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [discovery] 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): port = 8009 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [ceph] 2026-02-18T03:26:38.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): pool = mypool 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [mtls] 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [spdk] 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:26:38.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): transports = tcp 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): [monitor] 2026-02-18T03:26:38.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO state.py:891 (2): First gateway: created object nvmeof.mygroup0.state 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:26:38.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:38] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.86:5499 for group id 2026-02-18T03:26:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: pgmap v104: 33 pgs: 33 active+clean; 611 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 40 KiB/s rd, 32 KiB/s wr, 94 op/s 2026-02-18T03:26:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:39.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:39.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:38 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: pgmap v104: 33 pgs: 33 active+clean; 611 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 40 KiB/s rd, 32 KiB/s wr, 94 op/s 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: pgmap v104: 33 pgs: 33 active+clean; 611 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 40 KiB/s rd, 32 KiB/s wr, 94 op/s 2026-02-18T03:26:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:39.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:39.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:38 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:39.376 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:39.494 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:39.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Trying to pull quay.io/ceph/nvmeof:devel... 2026-02-18T03:26:39.723 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:39.723 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:38.637929Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:39.765 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:40.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:39 trial034 ceph-mon[21825]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:40.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:39 trial034 ceph-mon[21825]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:39 trial034 ceph-mon[21825]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:39 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:26:40.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Getting image source signatures 2026-02-18T03:26:40.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:e1ad571dfbd92db00152ab9cd6103ce1496b77b702f05f6f8a3c34f35c60b2c9 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:9bc0f775acafdf3d8cec026216b4d1af8405c4383413c5488232c22180fc440b 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:8d5bd62c11c679d096279fd5d8ef3c429c0843067310e0c75a0fb3a7a6bc56e5 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:c1222dc7ae510c1747954c83b2d87b79c1f7ad23a782e560bce90c2fb40fc391 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:3c74c9b146a29bfada03feb9fb249c05e0ba7dfa7a35ef659d40b403a3638baa 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:a7ffbc3af914b27a37e5a4bc0d1c4d4b85c7040f0ab0e4de4023ae4bdca097b3 2026-02-18T03:26:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:39 trial177 bash[25448]: Copying blob sha256:28334eab29c252fcb610de92adc0b20cbad462a56beba9241601f27496857eda 2026-02-18T03:26:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:39 trial155 ceph-mon[24719]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:39 trial155 ceph-mon[24719]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:39 trial155 ceph-mon[24719]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:39 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:26:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:39 trial086 ceph-mon[24100]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:39 trial086 ceph-mon[24100]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:39 trial086 ceph-mon[24100]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:26:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:39 trial086 ceph-mon[24100]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:26:40.765 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:40.883 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:41.112 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:41.112 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:38.637929Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:41.112 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:40 trial034 ceph-mon[21825]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:41.112 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:40 trial034 ceph-mon[21825]: pgmap v105: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:26:41.112 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:40 trial034 ceph-mon[21825]: osdmap e51: 8 total, 8 up, 8 in 2026-02-18T03:26:41.150 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:40 trial155 ceph-mon[24719]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:40 trial155 ceph-mon[24719]: pgmap v105: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:26:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:40 trial155 ceph-mon[24719]: osdmap e51: 8 total, 8 up, 8 in 2026-02-18T03:26:41.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:40 trial086 ceph-mon[24100]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:40 trial086 ceph-mon[24100]: pgmap v105: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 77 op/s 2026-02-18T03:26:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:40 trial086 ceph-mon[24100]: osdmap e51: 8 total, 8 up, 8 in 2026-02-18T03:26:42.151 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:42.270 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:42.509 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:42.509 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:38.637929Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:42.548 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:42 trial155 ceph-mon[24719]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:42 trial155 ceph-mon[24719]: pgmap v107: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 76 op/s 2026-02-18T03:26:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:42 trial034 ceph-mon[21825]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:42 trial034 ceph-mon[21825]: pgmap v107: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 76 op/s 2026-02-18T03:26:43.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:42 trial086 ceph-mon[24100]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:42 trial086 ceph-mon[24100]: pgmap v107: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 76 op/s 2026-02-18T03:26:43.549 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:43.668 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:43.899 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:43.899 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:38.637929Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:43.936 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:44.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:43 trial155 ceph-mon[24719]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:44.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:43 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:43 trial034 ceph-mon[21825]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:43 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:43 trial086 ceph-mon[24100]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:43 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:44.937 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:45.054 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:45.168 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:44 trial034 ceph-mon[21825]: pgmap v108: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 21 KiB/s wr, 65 op/s 2026-02-18T03:26:45.168 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:44 trial034 ceph-mon[21825]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:44 trial177 bash[25448]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:26:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:44 trial177 bash[25448]: Writing manifest to image destination 2026-02-18T03:26:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 podman[25448]: 2026-02-18 03:26:45.004198855 +0000 UTC m=+5.497112487 container create 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, org.centos.version=9.0-30.el9, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=25.09, build-date=2026-02-11 09:53:49 UTC, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, io.ceph.git.branch=devel, io.ceph.component=ceph-nvmeof, com.redhat.component=ubi9-container, vcs-type=git, release=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.build.ceph-release=20.2.0, summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:26:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 podman[25448]: 2026-02-18 03:26:44.998072366 +0000 UTC m=+5.490985998 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:26:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 podman[25448]: 2026-02-18 03:26:45.037235967 +0000 UTC m=+5.530149609 container init 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, org.centos.version=9.0-30.el9, io.spdk.version=25.09, url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.pkgdep-args=--rbd, io.ceph.nvmeof=, vendor=Red Hat, Inc., io.spdk.build.makeflags=, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.ceph.git.branch=devel, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, vcs-type=git, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, io.ceph.maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, build-date=2026-02-11 09:53:49 UTC, io.ceph.version=1.6.5, architecture=x86_64) 2026-02-18T03:26:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 podman[25448]: 2026-02-18 03:26:45.039482619 +0000 UTC m=+5.532396251 container start 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, vcs-type=git, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.ceph.nvmeof=, build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, io.spdk.version=25.09, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, distribution-scope=public, name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=) 2026-02-18T03:26:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 bash[25448]: 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 2026-02-18T03:26:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 systemd[1]: Started Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:26:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:44 trial155 ceph-mon[24719]: pgmap v108: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 21 KiB/s wr, 65 op/s 2026-02-18T03:26:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:44 trial155 ceph-mon[24719]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:45.291 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:45.291 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:45.088633Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:45.329 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:44 trial086 ceph-mon[24100]: pgmap v108: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 21 KiB/s wr, 65 op/s 2026-02-18T03:26:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:44 trial086 ceph-mon[24100]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:26:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:26:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:26:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:26:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:26:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:26:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [gateway] 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:26:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): port = 5500 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:26:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:26:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:26:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): force_tls = False 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:26:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [discovery] 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): port = 8009 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:26:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [ceph] 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): pool = mypool 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [mtls] 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:26:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [spdk] 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): transports = tcp 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:26:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): [monitor] 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:26:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:26:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:26:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:26:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:26:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:26:45] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.177:5499 for group id 2026-02-18T03:26:45.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:e1ad571dfbd92db00152ab9cd6103ce1496b77b702f05f6f8a3c34f35c60b2c9 2026-02-18T03:26:45.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:26:45.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:8d5bd62c11c679d096279fd5d8ef3c429c0843067310e0c75a0fb3a7a6bc56e5 2026-02-18T03:26:45.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:3c74c9b146a29bfada03feb9fb249c05e0ba7dfa7a35ef659d40b403a3638baa 2026-02-18T03:26:45.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:c1222dc7ae510c1747954c83b2d87b79c1f7ad23a782e560bce90c2fb40fc391 2026-02-18T03:26:45.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:45 trial155 bash[50402]: Copying blob sha256:9bc0f775acafdf3d8cec026216b4d1af8405c4383413c5488232c22180fc440b 2026-02-18T03:26:46.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:46 trial155 bash[50402]: Copying blob sha256:a7ffbc3af914b27a37e5a4bc0d1c4d4b85c7040f0ab0e4de4023ae4bdca097b3 2026-02-18T03:26:46.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:46 trial155 bash[50402]: Copying blob sha256:28334eab29c252fcb610de92adc0b20cbad462a56beba9241601f27496857eda 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:46.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:26:46.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:46.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:46 trial155 ceph-mon[24719]: pgmap v109: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2026-02-18T03:26:46.330 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:46.354 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:46.355 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:26:46.356 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:46.356 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:46 trial034 ceph-mon[21825]: pgmap v109: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:26:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:46 trial086 ceph-mon[24100]: pgmap v109: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2026-02-18T03:26:46.447 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:46.675 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:46.675 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:45.088633Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:46.714 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:47 trial086 ceph-mon[24100]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:47 trial155 ceph-mon[24719]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:47 trial034 ceph-mon[21825]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:47.715 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:47.834 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:48.065 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:48.065 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:45.088633Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:48.105 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:48 trial086 ceph-mon[24100]: pgmap v110: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 307 B/s rd, 614 B/s wr, 1 op/s 2026-02-18T03:26:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:48 trial155 ceph-mon[24719]: pgmap v110: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 307 B/s rd, 614 B/s wr, 1 op/s 2026-02-18T03:26:48.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:48 trial034 ceph-mon[21825]: pgmap v110: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 307 B/s rd, 614 B/s wr, 1 op/s 2026-02-18T03:26:49.106 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:49.225 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:49 trial086 ceph-mon[24100]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:49.453 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:49.453 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:45.088633Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:49.453 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:49 trial034 ceph-mon[21825]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:49 trial155 ceph-mon[24719]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:49.491 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:50 trial086 ceph-mon[24100]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:50 trial086 ceph-mon[24100]: pgmap v111: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:26:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:50 trial155 ceph-mon[24719]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:50 trial155 ceph-mon[24719]: pgmap v111: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:26:50.492 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:50.516 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:50 trial034 ceph-mon[21825]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:50.517 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:50 trial034 ceph-mon[21825]: pgmap v111: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 102 B/s wr, 0 op/s 2026-02-18T03:26:50.610 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:50.852 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:50.853 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:45.088633Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:50.891 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:51.340 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-mon[24719]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:51.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 bash[50402]: Copying config sha256:99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 bash[50402]: Writing manifest to image destination 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 podman[50402]: 2026-02-18 03:26:51.130927017 +0000 UTC m=+5.508943889 container create 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.spdk.version=25.09, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.version=9.0-30.el9, architecture=x86_64, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, vendor=Red Hat, Inc., vcs-type=git, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.ceph-release=20.2.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2026-02-11 09:53:49 UTC, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.buildah.version=1.29.0, io.ceph.maintainer=Ceph Developers , io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.branch=devel, release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, version=1.6.5, distribution-scope=public, name=ceph-nvmeof, io.spdk.build.makeflags=) 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 podman[50402]: 2026-02-18 03:26:51.124397138 +0000 UTC m=+5.502414000 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 podman[50402]: 2026-02-18 03:26:51.1642157 +0000 UTC m=+5.542232582 container init 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC, io.ceph.nvmeof=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, vendor=Red Hat, Inc., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, io.buildah.version=1.29.0, architecture=x86_64, io.spdk.build.makeflags=, distribution-scope=public, io.spdk.version=25.09, release=, io.spdk.build.target-arch=x86-64-v2, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.component=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.6.5, io.spdk.git.branch=undefined) 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 podman[50402]: 2026-02-18 03:26:51.166754895 +0000 UTC m=+5.544771757 container start 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.git.branch=undefined, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, name=ceph-nvmeof, architecture=x86_64, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, vcs-type=git, io.buildah.version=1.29.0, io.spdk.version=25.09, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, release=, io.ceph.nvmeof=, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, maintainer=Ceph Developers , io.openshift.wants=ceph,rbd, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom) 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 bash[50402]: 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 2026-02-18T03:26:51.341 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 systemd[1]: Started Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:26:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:51 trial086 ceph-mon[24100]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:51.417 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:51 trial034 ceph-mon[21825]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:26:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:26:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:26:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:26:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:26:51.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [gateway] 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): port = 5500 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:26:51.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:26:51.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:26:51.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:26:51.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): force_tls = False 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:26:51.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:26:51.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:26:51.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:26:51.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:26:51.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [discovery] 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): port = 8009 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [ceph] 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): pool = mypool 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [mtls] 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:26:51.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [spdk] 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): transports = tcp 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): [monitor] 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:26:51.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:26:51.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:26:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:26:51] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.155:5499 for group id 2026-02-18T03:26:51.892 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:52.012 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:52.262 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:52.262 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:51.215121Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:52.292 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.292 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.292 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: gateway address: 10.20.193.34 from map_addr=None spec.addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: discovery address: 10.20.193.34 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.a on trial034 2026-02-18T03:26:52.293 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:52 trial034 ceph-mon[21825]: pgmap v112: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:52.311 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: gateway address: 10.20.193.34 from map_addr=None spec.addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: discovery address: 10.20.193.34 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.a on trial034 2026-02-18T03:26:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:52 trial155 ceph-mon[24719]: pgmap v112: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:52.622 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: gateway address: 10.20.193.34 from map_addr=None spec.addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: discovery address: 10.20.193.34 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.34' 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: Deploying daemon nvmeof.nvmeof.a on trial034 2026-02-18T03:26:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:52 trial086 ceph-mon[24100]: pgmap v112: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:53.311 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:53 trial155 ceph-mon[24719]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:53 trial034 ceph-mon[21825]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:53.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:53 trial086 ceph-mon[24100]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:53.650 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:53.908 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:53.909 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:51.215121Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:53.949 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:54 trial155 ceph-mon[24719]: pgmap v113: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:54 trial155 ceph-mon[24719]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:54 trial034 ceph-mon[21825]: pgmap v113: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:54 trial034 ceph-mon[21825]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:54 trial086 ceph-mon[24100]: pgmap v113: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:54 trial086 ceph-mon[24100]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:54.950 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:56.580 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:57.050 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:57.050 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:25:22.603786Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:25:22.603718Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:56.949386Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "ports": [5500, 4420, 8009, 10008], "running": 0, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:25:22.603834Z", "running": 8, "size": 8}}] 2026-02-18T03:26:57.068 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:56 trial034 ceph-mon[21825]: pgmap v114: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:57.092 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 0/4 2026-02-18T03:26:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:56 trial155 ceph-mon[24719]: pgmap v114: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:57.251 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:56 trial086 ceph-mon[24100]: pgmap v114: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:58.094 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch ls -f json 2026-02-18T03:26:58.216 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:26:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:57 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.239 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:57 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:58.457 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:26:58.457 INFO:teuthology.orchestra.run.trial034.stdout:[{"events": ["2026-02-18T03:25:00.022687Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["trial034=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-18T03:25:00.014163Z", "last_refresh": "2026-02-18T03:26:57.513984Z", "running": 1, "size": 1}}, {"events": ["2026-02-18T03:24:53.027270Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["trial034:10.20.193.34=a", "trial086:10.20.193.86=b", "trial155:10.20.193.155=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-18T03:24:46.389126Z", "last_refresh": "2026-02-18T03:26:57.513913Z", "running": 3, "size": 3}}, {"events": ["2026-02-18T03:26:56.949386Z service:nvmeof.mypool.mygroup0 [INFO] \"service was created\""], "placement": {"hosts": ["trial034=nvmeof.a", "trial086=nvmeof.b", "trial155=nvmeof.c", "trial177=nvmeof.d"]}, "service_id": "mypool.mygroup0", "service_name": "nvmeof.mypool.mygroup0", "service_type": "nvmeof", "spec": {"abort_discovery_on_errors": true, "abort_on_errors": true, "abort_on_update_error": true, "allowed_consecutive_spdk_ping_failures": 1, "break_update_interval_sec": 25, "cluster_connections": 32, "conn_retries": 10, "discovery_bind_retries_limit": 10, "discovery_bind_sleep_interval": 0.5, "discovery_port": 8009, "enable_monitor_client": true, "enable_prometheus_exporter": true, "group": "mygroup0", "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_gws_in_grp": 16, "max_hosts": 2048, "max_hosts_per_namespace": 16, "max_hosts_per_subsystem": 128, "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "max_message_length_in_mb": 4, "max_namespaces": 4096, "max_namespaces_per_subsystem": 512, "max_namespaces_with_netmask": 1000, "max_ns_to_change_lb_grp": 8, "max_subsystems": 128, "monitor_timeout": 1.0, "notifications_interval": 60, "omap_file_lock_duration": 20, "omap_file_lock_on_read": true, "omap_file_lock_retries": 30, "omap_file_lock_retry_sleep_interval": 1.0, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "prometheus_connection_list_cache_expiration": 60, "prometheus_port": 10008, "prometheus_startup_delay": 240, "prometheus_stats_interval": 10, "rebalance_period_sec": 7, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_ping_interval_in_seconds": 2.0, "spdk_protocol_log_level": "WARNING", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "subsystem_cache_expiration": 5, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_keys": true, "verify_listener_ip": true, "verify_nqns": true}, "status": {"created": "2026-02-18T03:26:31.277745Z", "last_refresh": "2026-02-18T03:26:57.286578Z", "ports": [5500, 4420, 8009, 10008], "running": 4, "size": 4}}, {"events": ["2026-02-18T03:26:05.210004Z service:osd.default [INFO] \"service was created\""], "placement": {"host_pattern": "trial155"}, "service_id": "default", "service_name": "osd.default", "service_type": "osd", "spec": {"data_devices": {"paths": ["vg_nvme/lv_2"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-18T03:26:05.208385Z", "last_refresh": "2026-02-18T03:26:57.514042Z", "running": 8, "size": 8}}] 2026-02-18T03:26:58.497 INFO:tasks.cephadm:nvmeof.mypool.mygroup0 has 4/4 2026-02-18T03:26:58.497 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T03:26:58.522 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:26:58.523 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T03:26:58.523 DEBUG:teuthology.orchestra.run.trial014:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:26:58.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:26:58.540 INFO:teuthology.orchestra.run.trial014.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T03:26:58.540 DEBUG:teuthology.orchestra.run.trial014:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:26:58.598 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T03:26:58.599 DEBUG:teuthology.orchestra.run.trial014:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T03:26:58.656 INFO:tasks.workunit:timeout=3h 2026-02-18T03:26:58.656 INFO:tasks.workunit:cleanup=True 2026-02-18T03:26:58.657 DEBUG:teuthology.orchestra.run.trial014:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:26:58.720 INFO:tasks.workunit.client.0.trial014.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T03:26:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: pgmap v115: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:26:59.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:58 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:26:59.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:26:59] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: pgmap v115: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:26:59.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:26:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: pgmap v115: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:26:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:26:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:26:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: Health check failed: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway. (NVMEOF_SINGLE_GATEWAY) 2026-02-18T03:26:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:26:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:58 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:27:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: Cluster is now healthy 2026-02-18T03:27:00.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:00.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:27:00.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:27:00.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:27:00.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:27:00.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:27:00.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:26:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:26:59] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:27:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:27:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:27:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:27:00.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: Cluster is now healthy 2026-02-18T03:27:00.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:00.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:26:59 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-18T03:27:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: Health check cleared: NVMEOF_SINGLE_GATEWAY (was: 1 group(s) have only 1 nvmeof gateway; HA is not possible with single gateway.) 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: Cluster is now healthy 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:26:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:00 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:00 trial155 ceph-mon[24719]: pgmap v116: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:00 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:00 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:00 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:00 trial034 ceph-mon[21825]: pgmap v116: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:656 (2): SPDK process id: 79 2026-02-18T03:27:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:27:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: INFO: Setting log level to WARNING 2026-02-18T03:27:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:27:01.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.155264] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:27:01.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.155310] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid79 ] 2026-02-18T03:27:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:00 trial086 ceph-mon[24100]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:00 trial086 ceph-mon[24100]: pgmap v116: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:00 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:00 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:27:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:01] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:27:01.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.272379] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:27:01.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.298809] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:27:01.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.298819] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.298828] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.298829] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.418168] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:473 (2): Discovery service process id: 84 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:461 (84): Starting ceph nvmeof discovery service 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO state.py:894 (84): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO discovery.py:344 (84): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO discovery.py:369 (84): discovery addr: 10.20.193.34 port: 8009 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO state.py:2073 (84): Initialization is over (discovery-trial034). 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.465404] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:01.465433] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:27:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:01] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3606547032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/679082007' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:27:02.110 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.111 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.111 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:27:02.111 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.111 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.111 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:01] INFO server.py:656 (2): SPDK process id: 136 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:01] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: INFO: Setting log level to WARNING 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:01] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.840293] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.840337] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid136 ] 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.956094] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.983410] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.983419] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.983429] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:01.983430] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:27:02.111 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:02.109922] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3606547032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/679082007' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:01 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3606547032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/679082007' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:27:02.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:02.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:01 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:473 (2): Discovery service process id: 141 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:461 (141): Starting ceph nvmeof discovery service 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO state.py:894 (141): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO discovery.py:344 (141): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO discovery.py:369 (141): discovery addr: 10.20.193.86 port: 8009 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO state.py:2073 (141): Initialization is over (discovery-trial086). 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:02.157155] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:02.157181] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:27:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:02] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:27:02.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:02] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:27:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:27:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:27:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: pgmap v117: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:03.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:03.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/690708222' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:03.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:02 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3317107982' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:27:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: pgmap v117: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/690708222' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3317107982' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:27:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: pgmap v117: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/690708222' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:03.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:02 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3317107982' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:03.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:656 (2): SPDK process id: 103 2026-02-18T03:27:03.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:27:03.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: INFO: Setting log level to WARNING 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.417120] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.417167] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid103 ] 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.535354] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.558438] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.558447] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.558457] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.558458] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:27:03.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.682159] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:27:03.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:473 (2): Discovery service process id: 108 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:461 (108): Starting ceph nvmeof discovery service 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO state.py:894 (108): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO discovery.py:344 (108): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO discovery.py:369 (108): discovery addr: 10.20.193.155 port: 8009 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO state.py:2073 (108): Initialization is over (discovery-trial155). 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:27:03.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.729373] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:27:03.729405] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:27:03.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:03] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:27:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:04 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/4050424196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:04 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/4198098721' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:04 trial086 ceph-mon[24100]: pgmap v118: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:04 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4050424196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:04 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4198098721' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:04 trial155 ceph-mon[24719]: pgmap v118: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4050424196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4198098721' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:04 trial034 ceph-mon[21825]: pgmap v118: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:656 (2): SPDK process id: 124 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: INFO: Setting log level to WARNING 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.291222] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.291393] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid124 ] 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.407258] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:27:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.430914] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.430922] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.430932] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.430933] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:27:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.554342] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:27:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:27:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:473 (2): Discovery service process id: 129 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:461 (129): Starting ceph nvmeof discovery service 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO state.py:894 (129): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO discovery.py:344 (129): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO discovery.py:369 (129): discovery addr: 10.20.193.177 port: 8009 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO state.py:2073 (129): Initialization is over (discovery-trial177). 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:27:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.601582] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:27:04.601610] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:27:04.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:04] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:27:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:05 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/297485172' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:05 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/843852938' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/297485172' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/843852938' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/297485172' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:27:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/843852938' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:06 trial086 ceph-mon[24100]: pgmap v119: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:06 trial155 ceph-mon[24719]: pgmap v119: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:06 trial034 ceph-mon[21825]: pgmap v119: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:09.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:08 trial034 ceph-mon[21825]: pgmap v120: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:09.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:08 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3249517907' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:08 trial155 ceph-mon[24719]: pgmap v120: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:08 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3249517907' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:08 trial086 ceph-mon[24100]: pgmap v120: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:08 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3249517907' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:10.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:09 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3259804600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3259804600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:09 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3259804600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:11.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:10 trial155 ceph-mon[24719]: pgmap v121: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:11.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1227952191' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:10 trial034 ceph-mon[21825]: pgmap v121: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1227952191' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:10 trial086 ceph-mon[24100]: pgmap v121: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 3 op/s 2026-02-18T03:27:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:10 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1227952191' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:11 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2166011692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2166011692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:11 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/2166011692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:12 trial155 ceph-mon[24719]: pgmap v122: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:12 trial034 ceph-mon[21825]: pgmap v122: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:12 trial086 ceph-mon[24100]: pgmap v122: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:15.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:14 trial155 ceph-mon[24719]: pgmap v123: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:15.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:14 trial034 ceph-mon[21825]: pgmap v123: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:14 trial086 ceph-mon[24100]: pgmap v123: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:16.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/469013881' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:16.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/469013881' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:15 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/469013881' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:16 trial155 ceph-mon[24719]: pgmap v124: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:16 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/646862980' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:16 trial034 ceph-mon[21825]: pgmap v124: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/646862980' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:16 trial086 ceph-mon[24100]: pgmap v124: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:16 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/646862980' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:18.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4153830870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4153830870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/4153830870' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:18 trial155 ceph-mon[24719]: pgmap v125: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3418840427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:18 trial034 ceph-mon[21825]: pgmap v125: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3418840427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.335 INFO:tasks.workunit.client.0.trial014.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T03:27:19.335 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.335 INFO:tasks.workunit.client.0.trial014.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T03:27:19.335 INFO:tasks.workunit.client.0.trial014.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr: git switch -c 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr:Or undo this operation with: 2026-02-18T03:27:19.336 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.337 INFO:tasks.workunit.client.0.trial014.stderr: git switch - 2026-02-18T03:27:19.337 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.337 INFO:tasks.workunit.client.0.trial014.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T03:27:19.337 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:27:19.337 INFO:tasks.workunit.client.0.trial014.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T03:27:19.342 DEBUG:teuthology.orchestra.run.trial014:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T03:27:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:18 trial086 ceph-mon[24100]: pgmap v125: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:18 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/3418840427' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:19.401 INFO:tasks.workunit.client.0.trial014.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-18T03:27:19.403 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:27:19.403 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-18T03:27:19.500 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-18T03:27:19.532 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-18T03:27:19.555 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:27:19.557 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:27:19.557 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-18T03:27:19.582 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:27:19.586 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:27:19.586 DEBUG:teuthology.orchestra.run.trial014:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T03:27:19.645 INFO:tasks.workunit:Running workunits matching nvmeof/setup_subsystem.sh on client.0... 2026-02-18T03:27:19.648 INFO:tasks.workunit:Running workunit nvmeof/setup_subsystem.sh... 2026-02-18T03:27:19.648 DEBUG:teuthology.orchestra.run.trial014:workunit test nvmeof/setup_subsystem.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/setup_subsystem.sh 2026-02-18T03:27:19.703 INFO:tasks.workunit.client.0.trial014.stderr:+ source /etc/ceph/nvmeof.env 2026-02-18T03:27:19.703 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=10.20.193.34,10.20.193.86,10.20.193.155,10.20.193.177 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_GATEWAY_NAMES=trial034,trial086,trial155,trial177 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=10.20.193.34 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:devel 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=16 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_NAMESPACES_COUNT=4 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_PORT=4420 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SRPORT=5500 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:+ RBD_POOL=mypool 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:+ RBD_IMAGE_PREFIX=myimage 2026-02-18T03:27:19.704 INFO:tasks.workunit.client.0.trial014.stderr:++ hostname 2026-02-18T03:27:19.705 INFO:tasks.workunit.client.0.trial014.stderr:+ HOSTNAME=trial014 2026-02-18T03:27:19.705 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman images 2026-02-18T03:27:19.725 INFO:tasks.workunit.client.0.trial014.stdout:REPOSITORY TAG IMAGE ID CREATED SIZE 2026-02-18T03:27:19.726 INFO:tasks.workunit.client.0.trial014.stdout:quay.ceph.io/ceph-ci/ceph adc1923395f2bcd6ae89b5d331d278364d1848ed c2bc6184fe25 9 hours ago 1.5 GB 2026-02-18T03:27:19.727 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman ps 2026-02-18T03:27:19.747 INFO:tasks.workunit.client.0.trial014.stdout:CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-02-18T03:27:19.749 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 --format json subsystem list 2026-02-18T03:27:19.768 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:19.770 INFO:tasks.workunit.client.0.trial014.stderr:Trying to pull quay.io/ceph/nvmeof-cli:devel... 2026-02-18T03:27:20.256 INFO:tasks.workunit.client.0.trial014.stderr:Getting image source signatures 2026-02-18T03:27:20.256 INFO:tasks.workunit.client.0.trial014.stderr:Copying blob sha256:a1657f41d50b3dea43d9f14f954d778bf71e11849920e76a92e0a7a1ed54a9c6 2026-02-18T03:27:20.257 INFO:tasks.workunit.client.0.trial014.stderr:Copying blob sha256:8d156a03ba1d0e221bdc715d1f586584566143ee24d6a8ce5862d2d78a537de8 2026-02-18T03:27:20.257 INFO:tasks.workunit.client.0.trial014.stderr:Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2026-02-18T03:27:20.257 INFO:tasks.workunit.client.0.trial014.stderr:Copying blob sha256:4911ac1c694be040dfc35b15ab9a3e8fe41402902e5ffc1951f5e80fe270d569 2026-02-18T03:27:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:20 trial155 ceph-mon[24719]: pgmap v126: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:20 trial034 ceph-mon[21825]: pgmap v126: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:20 trial086 ceph-mon[24100]: pgmap v126: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:22.815 INFO:tasks.workunit.client.0.trial014.stderr:Copying config sha256:c1d149b89595cfbff7052465bea1a1a102db7eda9044d53e28d55eb8b3d1b1d3 2026-02-18T03:27:22.816 INFO:tasks.workunit.client.0.trial014.stderr:Writing manifest to image destination 2026-02-18T03:27:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:22 trial155 ceph-mon[24719]: pgmap v127: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3576728214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:23.266 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:22 trial034 ceph-mon[21825]: pgmap v127: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:23.267 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3576728214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:23.275 INFO:tasks.workunit.client.0.trial014.stdout:{ 2026-02-18T03:27:23.275 INFO:tasks.workunit.client.0.trial014.stdout: "error_message": "Success", 2026-02-18T03:27:23.275 INFO:tasks.workunit.client.0.trial014.stdout: "status": 0, 2026-02-18T03:27:23.275 INFO:tasks.workunit.client.0.trial014.stdout: "subsystems": [] 2026-02-18T03:27:23.276 INFO:tasks.workunit.client.0.trial014.stdout:} 2026-02-18T03:27:23.297 INFO:tasks.workunit.client.0.trial014.stderr:+ IFS=, 2026-02-18T03:27:23.297 INFO:tasks.workunit.client.0.trial014.stderr:+ read -ra gateway_ips 2026-02-18T03:27:23.297 INFO:tasks.workunit.client.0.trial014.stderr:+ IFS=, 2026-02-18T03:27:23.297 INFO:tasks.workunit.client.0.trial014.stderr:+ read -ra gateway_names 2026-02-18T03:27:23.298 INFO:tasks.workunit.client.0.trial014.stderr:++ echo 10.20.193.34,10.20.193.86,10.20.193.155,10.20.193.177 2026-02-18T03:27:23.298 INFO:tasks.workunit.client.0.trial014.stderr:++ tr -cd , 2026-02-18T03:27:23.298 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -c 2026-02-18T03:27:23.299 INFO:tasks.workunit.client.0.trial014.stderr:+ gateways_count=4 2026-02-18T03:27:23.299 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Starting subsystem setup...' 2026-02-18T03:27:23.299 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Starting subsystem setup... 2026-02-18T03:27:23.300 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:27:23.300 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:23.300 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:27:23.300 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode1 --no-group-append 2026-02-18T03:27:23.340 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:22 trial086 ceph-mon[24100]: pgmap v127: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:27:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3576728214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:23.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:23] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.14:57452 2026-02-18T03:27:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2954880562' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2954880562' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:24.329 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2954880562' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:24.332 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:27:24.351 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:24.352 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:27:24.352 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode2 --no-group-append 2026-02-18T03:27:24.384 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:24.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:59764 2026-02-18T03:27:24.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:24.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode1, will use Ceph14926682106859 2026-02-18T03:27:24.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:24.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode1, OMAP version: 2 2026-02-18T03:27:24.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:24.860 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:27:24.878 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:24.879 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:27:24.879 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode3 --no-group-append 2026-02-18T03:27:24.917 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:25.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-mon[24100]: pgmap v128: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:25.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] INFO state.py:1684 (141): Start update from 1 to 2 (discovery-trial086). 2026-02-18T03:27:25.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] INFO state.py:2068 (141): Update complete (1 -> 2) (discovery-trial086). 2026-02-18T03:27:25.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:25.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:25.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] INFO state.py:1684 (129): Start update from 1 to 2 (discovery-trial177). 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] INFO state.py:2068 (129): Update complete (1 -> 2) (discovery-trial177). 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:25.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:24] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-mon[24719]: pgmap v128: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:25.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] INFO state.py:1684 (108): Start update from 1 to 2 (discovery-trial155). 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] INFO state.py:2068 (108): Update complete (1 -> 2) (discovery-trial155). 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] INFO state.py:1684 (2): Start update from 1 to 2 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] INFO state.py:2068 (2): Update complete (1 -> 2) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-mon[21825]: pgmap v128: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:1684 (84): Start update from 1 to 2 (discovery-trial034). 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:2068 (84): Update complete (1 -> 2) (discovery-trial034). 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:42142 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode2, will use Ceph91399272374620 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode2, OMAP version: 3 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:24] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.396 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:27:25.420 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:25.420 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:27:25.420 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode4 --no-group-append 2026-02-18T03:27:25.467 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:1684 (141): Start update from 2 to 3 (discovery-trial086). 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:2068 (141): Update complete (2 -> 3) (discovery-trial086). 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:1684 (129): Start update from 2 to 3 (discovery-trial177). 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:2068 (129): Update complete (2 -> 3) (discovery-trial177). 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:25.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:1684 (108): Start update from 2 to 3 (discovery-trial155). 2026-02-18T03:27:25.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:2068 (108): Update complete (2 -> 3) (discovery-trial155). 2026-02-18T03:27:25.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 2 to 3 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:25.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:25.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (2 -> 3) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:25.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:1684 (84): Start update from 2 to 3 (discovery-trial034). 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:2068 (84): Update complete (2 -> 3) (discovery-trial034). 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:33132 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode3, will use Ceph61801836239121 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode3, OMAP version: 4 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:25.928 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:27:25.946 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:25.946 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:27:25.946 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode5 --no-group-append 2026-02-18T03:27:25.980 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:1684 (129): Start update from 3 to 4 (discovery-trial177). 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:2068 (129): Update complete (3 -> 4) (discovery-trial177). 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:25] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:1684 (108): Start update from 3 to 4 (discovery-trial155). 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:2068 (108): Update complete (3 -> 4) (discovery-trial155). 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:1684 (84): Start update from 3 to 4 (discovery-trial034). 2026-02-18T03:27:26.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:2068 (84): Update complete (3 -> 4) (discovery-trial034). 2026-02-18T03:27:26.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:58000 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode4, will use Ceph56247354555456 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode4, OMAP version: 5 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:25] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:1684 (141): Start update from 3 to 4 (discovery-trial086). 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:2068 (141): Update complete (3 -> 4) (discovery-trial086). 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:1684 (2): Start update from 3 to 4 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] INFO state.py:2068 (2): Update complete (3 -> 4) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.431 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:27:26.451 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:26.451 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:27:26.451 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode6 --no-group-append 2026-02-18T03:27:26.491 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:45354 2026-02-18T03:27:26.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode5, will use Ceph40845607382583 2026-02-18T03:27:26.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:26.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode5, OMAP version: 6 2026-02-18T03:27:26.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:26.956 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:27:26.976 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:26.976 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:27:26.976 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode7 --no-group-append 2026-02-18T03:27:27.009 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO state.py:1684 (129): Start update from 4 to 6 (discovery-trial177). 2026-02-18T03:27:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO state.py:2068 (129): Update complete (4 -> 6) (discovery-trial177). 2026-02-18T03:27:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-mon[24719]: pgmap v129: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 341 B/s wr, 16 op/s 2026-02-18T03:27:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO state.py:1684 (108): Start update from 4 to 6 (discovery-trial155). 2026-02-18T03:27:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO state.py:2068 (108): Update complete (4 -> 6) (discovery-trial155). 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-mon[21825]: pgmap v129: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 341 B/s wr, 16 op/s 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO state.py:1684 (84): Start update from 4 to 6 (discovery-trial034). 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO state.py:2068 (84): Update complete (4 -> 6) (discovery-trial034). 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:49370 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode6, will use Ceph50531101135613 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode6, OMAP version: 7 2026-02-18T03:27:27.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-mon[24100]: pgmap v129: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 341 B/s wr, 16 op/s 2026-02-18T03:27:27.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO state.py:1684 (141): Start update from 4 to 6 (discovery-trial086). 2026-02-18T03:27:27.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO state.py:2068 (141): Update complete (4 -> 6) (discovery-trial086). 2026-02-18T03:27:27.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO state.py:1684 (2): Start update from 4 to 6 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] INFO state.py:2068 (2): Update complete (4 -> 6) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:27] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:27] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:27] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:27] INFO state.py:1684 (129): Start update from 6 to 7 (discovery-trial177). 2026-02-18T03:27:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:27] INFO state.py:2068 (129): Update complete (6 -> 7) (discovery-trial177). 2026-02-18T03:27:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:27] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:27] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:27] INFO state.py:1684 (108): Start update from 6 to 7 (discovery-trial155). 2026-02-18T03:27:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:27] INFO state.py:2068 (108): Update complete (6 -> 7) (discovery-trial155). 2026-02-18T03:27:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:27] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:27.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:27] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:54672 2026-02-18T03:27:27.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:27] INFO state.py:1684 (84): Start update from 6 to 7 (discovery-trial034). 2026-02-18T03:27:27.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:27] INFO state.py:2068 (84): Update complete (6 -> 7) (discovery-trial034). 2026-02-18T03:27:27.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:27.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:27] INFO state.py:1684 (2): Start update from 6 to 7 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:27.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:27] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:27.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:27] INFO state.py:2068 (2): Update complete (6 -> 7) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:27.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:27] INFO state.py:1684 (141): Start update from 6 to 7 (discovery-trial086). 2026-02-18T03:27:27.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:27] INFO state.py:2068 (141): Update complete (6 -> 7) (discovery-trial086). 2026-02-18T03:27:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1382083106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:27 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3358378587' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1382083106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3358378587' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/1382083106' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:27 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3358378587' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:28.477 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:27:28.503 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:28.503 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:27:28.503 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode8 --no-group-append 2026-02-18T03:27:28.547 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:28.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 2 retries 2026-02-18T03:27:28.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode7, will use Ceph68079984791060 2026-02-18T03:27:28.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:28.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode7, OMAP version: 8 2026-02-18T03:27:28.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:28.996 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:27:29.015 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:29.015 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:27:29.016 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode9 --no-group-append 2026-02-18T03:27:29.059 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-mon[24719]: pgmap v130: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:29.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] INFO state.py:1684 (108): Start update from 7 to 8 (discovery-trial155). 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] INFO state.py:2068 (108): Update complete (7 -> 8) (discovery-trial155). 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] INFO state.py:1684 (2): Start update from 7 to 8 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] INFO state.py:2068 (2): Update complete (7 -> 8) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-mon[21825]: pgmap v130: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:1684 (84): Start update from 7 to 8 (discovery-trial034). 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:2068 (84): Update complete (7 -> 8) (discovery-trial034). 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:45742 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode8, will use Ceph54002212482360 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode8, OMAP version: 9 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:28] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-mon[24100]: pgmap v130: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:29.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] INFO state.py:1684 (2): Start update from 7 to 8 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:29.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] INFO state.py:1684 (141): Start update from 7 to 8 (discovery-trial086). 2026-02-18T03:27:29.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] INFO state.py:2068 (141): Update complete (7 -> 8) (discovery-trial086). 2026-02-18T03:27:29.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] INFO state.py:2068 (2): Update complete (7 -> 8) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:29.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:28] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] INFO state.py:1684 (129): Start update from 7 to 8 (discovery-trial177). 2026-02-18T03:27:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] INFO state.py:2068 (129): Update complete (7 -> 8) (discovery-trial177). 2026-02-18T03:27:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] INFO state.py:1684 (2): Start update from 7 to 8 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] INFO state.py:2068 (2): Update complete (7 -> 8) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:28] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:29.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:55816 2026-02-18T03:27:29.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:29.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:29] INFO state.py:1684 (84): Start update from 8 to 9 (discovery-trial034). 2026-02-18T03:27:29.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:29] INFO state.py:2068 (84): Update complete (8 -> 9) (discovery-trial034). 2026-02-18T03:27:29.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:29] INFO state.py:1684 (2): Start update from 8 to 9 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:29.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:29] INFO state.py:1684 (141): Start update from 8 to 9 (discovery-trial086). 2026-02-18T03:27:29.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:29] INFO state.py:2068 (141): Update complete (8 -> 9) (discovery-trial086). 2026-02-18T03:27:29.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:29] INFO state.py:2068 (2): Update complete (8 -> 9) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:29.914 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:29] INFO state.py:1684 (108): Start update from 8 to 9 (discovery-trial155). 2026-02-18T03:27:29.914 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:29] INFO state.py:2068 (108): Update complete (8 -> 9) (discovery-trial155). 2026-02-18T03:27:29.914 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:29] INFO state.py:1684 (2): Start update from 8 to 9 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:29.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:29] INFO state.py:2068 (2): Update complete (8 -> 9) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:29] INFO state.py:1684 (2): Start update from 8 to 9 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:29] INFO state.py:1684 (129): Start update from 8 to 9 (discovery-trial177). 2026-02-18T03:27:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:29] INFO state.py:2068 (129): Update complete (8 -> 9) (discovery-trial177). 2026-02-18T03:27:29.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:29] INFO state.py:2068 (2): Update complete (8 -> 9) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1978797748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:30.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1978797748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:29 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1978797748' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:30.512 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:27:30.535 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:30.535 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:27:30.535 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode10 --no-group-append 2026-02-18T03:27:30.579 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode9, will use Ceph48985563661949 2026-02-18T03:27:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode9, OMAP version: 10 2026-02-18T03:27:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:30] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:30] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:30] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:30.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:30] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.048 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:27:31.067 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:31.067 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:27:31.067 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode11 --no-group-append 2026-02-18T03:27:31.107 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:30 trial155 ceph-mon[24719]: pgmap v131: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:30 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/575144514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:31.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:1684 (108): Start update from 9 to 10 (discovery-trial155). 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:2068 (108): Update complete (9 -> 10) (discovery-trial155). 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 9 to 10 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (9 -> 10) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-mon[21825]: pgmap v131: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/575144514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:1684 (84): Start update from 9 to 10 (discovery-trial034). 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:2068 (84): Update complete (9 -> 10) (discovery-trial034). 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:42074 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode10, will use Ceph55936123663244 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode10, OMAP version: 11 2026-02-18T03:27:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:30 trial086 ceph-mon[24100]: pgmap v131: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 341 B/s wr, 12 op/s 2026-02-18T03:27:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:30 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/575144514' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:1684 (141): Start update from 9 to 10 (discovery-trial086). 2026-02-18T03:27:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:2068 (141): Update complete (9 -> 10) (discovery-trial086). 2026-02-18T03:27:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 9 to 10 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (9 -> 10) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 9 to 10 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:31.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:1684 (129): Start update from 9 to 10 (discovery-trial177). 2026-02-18T03:27:31.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:2068 (129): Update complete (9 -> 10) (discovery-trial177). 2026-02-18T03:27:31.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (9 -> 10) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:31.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:31.506 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:27:31.525 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:31.525 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:27:31.526 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode12 --no-group-append 2026-02-18T03:27:31.560 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:34944 2026-02-18T03:27:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode11, will use Ceph70783795201823 2026-02-18T03:27:31.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:31.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode11, OMAP version: 12 2026-02-18T03:27:31.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:1684 (84): Start update from 10 to 12 (discovery-trial034). 2026-02-18T03:27:31.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:2068 (84): Update complete (10 -> 12) (discovery-trial034). 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:1684 (141): Start update from 10 to 12 (discovery-trial086). 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:2068 (141): Update complete (10 -> 12) (discovery-trial086). 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 10 to 12 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (10 -> 12) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 10 to 12 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:1684 (129): Start update from 10 to 12 (discovery-trial177). 2026-02-18T03:27:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:2068 (129): Update complete (10 -> 12) (discovery-trial177). 2026-02-18T03:27:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (10 -> 12) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:31.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:1684 (108): Start update from 10 to 12 (discovery-trial155). 2026-02-18T03:27:31.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:2068 (108): Update complete (10 -> 12) (discovery-trial155). 2026-02-18T03:27:31.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:1684 (2): Start update from 10 to 12 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:31.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:31.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:31] INFO state.py:2068 (2): Update complete (10 -> 12) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:32.008 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:27:32.027 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:32.027 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:27:32.028 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode13 --no-group-append 2026-02-18T03:27:32.071 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:32.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:45986 2026-02-18T03:27:32.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode12, will use Ceph75694736504890 2026-02-18T03:27:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:31] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode12, OMAP version: 13 2026-02-18T03:27:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:32.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:47858 2026-02-18T03:27:32.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:32.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] INFO state.py:1684 (84): Start update from 12 to 13 (discovery-trial034). 2026-02-18T03:27:32.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:32] INFO state.py:2068 (84): Update complete (12 -> 13) (discovery-trial034). 2026-02-18T03:27:32.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] INFO state.py:1684 (2): Start update from 12 to 13 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:32.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:32.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] INFO state.py:1684 (141): Start update from 12 to 13 (discovery-trial086). 2026-02-18T03:27:32.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] INFO state.py:2068 (141): Update complete (12 -> 13) (discovery-trial086). 2026-02-18T03:27:32.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:32] INFO state.py:2068 (2): Update complete (12 -> 13) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:32.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] INFO state.py:1684 (108): Start update from 12 to 13 (discovery-trial155). 2026-02-18T03:27:32.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] INFO state.py:2068 (108): Update complete (12 -> 13) (discovery-trial155). 2026-02-18T03:27:32.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] INFO state.py:1684 (2): Start update from 12 to 13 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:32.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:32.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:32] INFO state.py:2068 (2): Update complete (12 -> 13) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] INFO state.py:1684 (2): Start update from 12 to 13 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] INFO state.py:1684 (129): Start update from 12 to 13 (discovery-trial177). 2026-02-18T03:27:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] INFO state.py:2068 (129): Update complete (12 -> 13) (discovery-trial177). 2026-02-18T03:27:32.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:32] INFO state.py:2068 (2): Update complete (12 -> 13) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:32 trial155 ceph-mon[24719]: pgmap v132: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 33 KiB/s rd, 1.3 KiB/s wr, 44 op/s 2026-02-18T03:27:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:32 trial034 ceph-mon[21825]: pgmap v132: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 33 KiB/s rd, 1.3 KiB/s wr, 44 op/s 2026-02-18T03:27:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:32 trial086 ceph-mon[24100]: pgmap v132: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 33 KiB/s rd, 1.3 KiB/s wr, 44 op/s 2026-02-18T03:27:33.525 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:27:33.548 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:33.548 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:27:33.548 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode14 --no-group-append 2026-02-18T03:27:33.584 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:33.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode13, will use Ceph51496246911324 2026-02-18T03:27:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode13, OMAP version: 14 2026-02-18T03:27:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:33] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:33] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:33] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:33] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:34] INFO state.py:1684 (2): Start update from 13 to 14 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:34] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:34] INFO state.py:1684 (141): Start update from 13 to 14 (discovery-trial086). 2026-02-18T03:27:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:34] INFO state.py:2068 (141): Update complete (13 -> 14) (discovery-trial086). 2026-02-18T03:27:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:34] INFO state.py:2068 (2): Update complete (13 -> 14) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:34] INFO state.py:1684 (2): Start update from 13 to 14 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:34] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:34] INFO state.py:1684 (129): Start update from 13 to 14 (discovery-trial177). 2026-02-18T03:27:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:34] INFO state.py:2068 (129): Update complete (13 -> 14) (discovery-trial177). 2026-02-18T03:27:34.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:34] INFO state.py:2068 (2): Update complete (13 -> 14) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:34] INFO state.py:1684 (108): Start update from 13 to 14 (discovery-trial155). 2026-02-18T03:27:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:34] INFO state.py:2068 (108): Update complete (13 -> 14) (discovery-trial155). 2026-02-18T03:27:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:34] INFO state.py:1684 (2): Start update from 13 to 14 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:34] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:34] INFO state.py:2068 (2): Update complete (13 -> 14) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:34] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:45704 2026-02-18T03:27:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:34] INFO state.py:1684 (84): Start update from 13 to 14 (discovery-trial034). 2026-02-18T03:27:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:34] INFO state.py:2068 (84): Update complete (13 -> 14) (discovery-trial034). 2026-02-18T03:27:35.036 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:27:35.058 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:35.058 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:27:35.059 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode15 --no-group-append 2026-02-18T03:27:35.092 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-mon[24719]: pgmap v133: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2026-02-18T03:27:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/499856705' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:34 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3439431122' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:35] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-mon[21825]: pgmap v133: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2026-02-18T03:27:35.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/499856705' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3439431122' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:35.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode14, will use Ceph65615196794868 2026-02-18T03:27:35.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:35.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode14, OMAP version: 15 2026-02-18T03:27:35.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-mon[24100]: pgmap v133: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 30 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2026-02-18T03:27:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/499856705' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:34 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3439431122' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:35.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:35] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:35] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.541 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:27:35.560 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:35.560 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:27:35.560 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode16 --no-group-append 2026-02-18T03:27:35.603 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:35] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:35] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:35] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:35.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:51406 2026-02-18T03:27:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode15, will use Ceph33754540835311 2026-02-18T03:27:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:35] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode15, OMAP version: 16 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO state.py:1684 (141): Start update from 14 to 16 (discovery-trial086). 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO state.py:2068 (141): Update complete (14 -> 16) (discovery-trial086). 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO state.py:1684 (2): Start update from 14 to 16 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:36] INFO state.py:2068 (2): Update complete (14 -> 16) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO state.py:1684 (2): Start update from 14 to 16 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO state.py:1684 (129): Start update from 14 to 16 (discovery-trial177). 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO state.py:2068 (129): Update complete (14 -> 16) (discovery-trial177). 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:36] INFO state.py:2068 (2): Update complete (14 -> 16) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO state.py:1684 (108): Start update from 14 to 16 (discovery-trial155). 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO state.py:2068 (108): Update complete (14 -> 16) (discovery-trial155). 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO state.py:1684 (2): Start update from 14 to 16 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:36] INFO state.py:2068 (2): Update complete (14 -> 16) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:36] INFO state.py:1684 (84): Start update from 14 to 16 (discovery-trial034). 2026-02-18T03:27:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:36] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 0, no group append: True, network mask: [], secure listeners: False, context: , client address: IPv4 10.20.193.14:59840 2026-02-18T03:27:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:36] INFO state.py:2068 (84): Update complete (14 -> 16) (discovery-trial034). 2026-02-18T03:27:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:37.060 INFO:tasks.workunit.client.0.trial014.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:27:37.082 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:27:37.082 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.34 2026-02-18T03:27:37.082 INFO:tasks.workunit.client.0.trial014.stderr:+ name=trial034 2026-02-18T03:27:37.082 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:27:37.084 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:37.084 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:27:37.084 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:37.084 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:37.085 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:37.122 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-mon[24719]: pgmap v134: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 64 op/s 2026-02-18T03:27:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/328693882' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-mon[21825]: pgmap v134: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 64 op/s 2026-02-18T03:27:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/328693882' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO grpc.py:1923 (2): No serial number specified for nqn.2016-06.io.spdk:cnode16, will use Ceph66503271982671 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO grpc.py:1929 (2): Subsystem NQN will not be changed 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO state.py:1053 (2): omap_key generated: subsystem_nqn.2016-06.io.spdk:cnode16, OMAP version: 17 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-mon[24100]: pgmap v134: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 64 op/s 2026-02-18T03:27:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/328693882' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:37.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:37.533 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:37.552 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:37.552 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:27:37.552 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:37.553 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:37.553 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:37.583 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:37.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:48660 2026-02-18T03:27:37.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:27:37.518137] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.34 port 4420 *** 2026-02-18T03:27:37.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial034_TCP_10.20.193.34_4420, OMAP version: 18 2026-02-18T03:27:37.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO state.py:1684 (84): Start update from 16 to 18 (discovery-trial034). 2026-02-18T03:27:37.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:37] INFO state.py:2068 (84): Update complete (16 -> 18) (discovery-trial034). 2026-02-18T03:27:37.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO state.py:1684 (141): Start update from 16 to 18 (discovery-trial086). 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO state.py:2068 (141): Update complete (16 -> 18) (discovery-trial086). 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO state.py:1684 (2): Start update from 16 to 18 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:37.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:37] INFO state.py:2068 (2): Update complete (16 -> 18) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO state.py:1684 (108): Start update from 16 to 18 (discovery-trial155). 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO state.py:2068 (108): Update complete (16 -> 18) (discovery-trial155). 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO state.py:1684 (2): Start update from 16 to 18 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:37.934 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:37] INFO state.py:2068 (2): Update complete (16 -> 18) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO state.py:1684 (2): Start update from 16 to 18 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO state.py:1684 (129): Start update from 16 to 18 (discovery-trial177). 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO state.py:2068 (129): Update complete (16 -> 18) (discovery-trial177). 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:37] INFO state.py:2068 (2): Update complete (16 -> 18) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:38.032 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:38.052 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:38.052 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:27:38.052 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:38.052 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:38.052 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:38.094 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:38.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:37 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/4007912593' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:38] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4007912593' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:38.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:45912 2026-02-18T03:27:38.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:38.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial034_TCP_10.20.193.34_4420, OMAP version: 19 2026-02-18T03:27:38.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:37 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/4007912593' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:38.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:38] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:38] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.541 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:38.791 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:38.791 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:27:38.791 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:38.791 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:38.792 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode4 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:38.859 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:38.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:38] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:42630 2026-02-18T03:27:38.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial034_TCP_10.20.193.34_4420, OMAP version: 20 2026-02-18T03:27:38.937 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:38] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.938 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:38] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.133 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode4 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:39.152 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:39.152 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:27:39.152 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:39.153 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:39.153 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode5 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:39.195 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:38 trial155 ceph-mon[24719]: pgmap v135: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:39.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:1684 (108): Start update from 18 to 20 (discovery-trial155). 2026-02-18T03:27:39.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:2068 (108): Update complete (18 -> 20) (discovery-trial155). 2026-02-18T03:27:39.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 18 to 20 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (18 -> 20) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-mon[21825]: pgmap v135: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:38] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:27:39.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:27:39.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:27:39.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:27:39.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 1 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: ], , client address: IPv4 10.20.193.34:60564 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:1684 (84): Start update from 18 to 20 (discovery-trial034). 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:2068 (84): Update complete (18 -> 20) (discovery-trial034). 2026-02-18T03:27:39.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:60902 2026-02-18T03:27:39.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:39.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode4_trial034_TCP_10.20.193.34_4420, OMAP version: 21 2026-02-18T03:27:39.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:38 trial086 ceph-mon[24100]: pgmap v135: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:39.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:1684 (141): Start update from 18 to 20 (discovery-trial086). 2026-02-18T03:27:39.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:2068 (141): Update complete (18 -> 20) (discovery-trial086). 2026-02-18T03:27:39.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 18 to 20 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (18 -> 20) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 18 to 20 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:39.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (18 -> 20) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:39.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:1684 (129): Start update from 18 to 20 (discovery-trial177). 2026-02-18T03:27:39.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:2068 (129): Update complete (18 -> 20) (discovery-trial177). 2026-02-18T03:27:39.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.677 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode5 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:39.698 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:39.698 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:27:39.698 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:39.699 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:39.699 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode6 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:39.740 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:1684 (129): Start update from 20 to 21 (discovery-trial177). 2026-02-18T03:27:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] INFO state.py:2068 (129): Update complete (20 -> 21) (discovery-trial177). 2026-02-18T03:27:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:39] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:1684 (108): Start update from 20 to 21 (discovery-trial155). 2026-02-18T03:27:39.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:2068 (108): Update complete (20 -> 21) (discovery-trial155). 2026-02-18T03:27:39.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:39.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:39.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:39.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:39.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:39.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:1684 (84): Start update from 20 to 21 (discovery-trial034). 2026-02-18T03:27:40.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:2068 (84): Update complete (20 -> 21) (discovery-trial034). 2026-02-18T03:27:40.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:50222 2026-02-18T03:27:40.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:40.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode5_trial034_TCP_10.20.193.34_4420, OMAP version: 22 2026-02-18T03:27:40.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:39] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:1684 (141): Start update from 20 to 21 (discovery-trial086). 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:2068 (141): Update complete (20 -> 21) (discovery-trial086). 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:1684 (2): Start update from 20 to 21 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] INFO state.py:2068 (2): Update complete (20 -> 21) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.216 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode6 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:40.236 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:40.236 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:27:40.237 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:40.237 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:40.237 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode7 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:40.280 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:1684 (129): Start update from 21 to 22 (discovery-trial177). 2026-02-18T03:27:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:2068 (129): Update complete (21 -> 22) (discovery-trial177). 2026-02-18T03:27:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:1684 (108): Start update from 21 to 22 (discovery-trial155). 2026-02-18T03:27:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:2068 (108): Update complete (21 -> 22) (discovery-trial155). 2026-02-18T03:27:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:40.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:40.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:1684 (84): Start update from 21 to 22 (discovery-trial034). 2026-02-18T03:27:40.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:2068 (84): Update complete (21 -> 22) (discovery-trial034). 2026-02-18T03:27:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51270 2026-02-18T03:27:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode6_trial034_TCP_10.20.193.34_4420, OMAP version: 23 2026-02-18T03:27:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:1684 (141): Start update from 21 to 22 (discovery-trial086). 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:2068 (141): Update complete (21 -> 22) (discovery-trial086). 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 21 to 22 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (21 -> 22) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.790 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:1684 (108): Start update from 22 to 23 (discovery-trial155). 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:2068 (108): Update complete (22 -> 23) (discovery-trial155). 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:40.791 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.793 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode7 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:40.815 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:40.816 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:27:40.816 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:40.816 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:40.816 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode8 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:40.860 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:27:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: OPTIMIZED 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: ], , client address: IPv4 10.20.193.34:60590 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:1684 (84): Start update from 22 to 23 (discovery-trial034). 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:2068 (84): Update complete (22 -> 23) (discovery-trial034). 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:58714 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:40.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode7_trial034_TCP_10.20.193.34_4420, OMAP version: 24 2026-02-18T03:27:40.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:40.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:40] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-mon[24100]: pgmap v136: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:1684 (141): Start update from 22 to 23 (discovery-trial086). 2026-02-18T03:27:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:2068 (141): Update complete (22 -> 23) (discovery-trial086). 2026-02-18T03:27:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:41.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:41.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:41.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:41.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:1684 (2): Start update from 22 to 23 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:2068 (2): Update complete (22 -> 23) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:1684 (129): Start update from 22 to 23 (discovery-trial177). 2026-02-18T03:27:41.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] INFO state.py:2068 (129): Update complete (22 -> 23) (discovery-trial177). 2026-02-18T03:27:41.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:40] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-mon[24719]: pgmap v136: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:41.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:40 trial034 ceph-mon[21825]: pgmap v136: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:27:41.364 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode8 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:41.386 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:41.386 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:27:41.387 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:41.387 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:41.387 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode9 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:41.425 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:41.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO state.py:1684 (141): Start update from 23 to 24 (discovery-trial086). 2026-02-18T03:27:41.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO state.py:2068 (141): Update complete (23 -> 24) (discovery-trial086). 2026-02-18T03:27:41.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:41.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:41.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:41.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:41.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO state.py:1684 (129): Start update from 23 to 24 (discovery-trial177). 2026-02-18T03:27:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] INFO state.py:2068 (129): Update complete (23 -> 24) (discovery-trial177). 2026-02-18T03:27:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO state.py:1684 (108): Start update from 23 to 24 (discovery-trial155). 2026-02-18T03:27:41.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO state.py:2068 (108): Update complete (23 -> 24) (discovery-trial155). 2026-02-18T03:27:41.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO state.py:1684 (2): Start update from 23 to 24 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:41.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:41.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:41.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] INFO state.py:2068 (2): Update complete (23 -> 24) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:41.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO state.py:1684 (84): Start update from 23 to 24 (discovery-trial034). 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO state.py:2068 (84): Update complete (23 -> 24) (discovery-trial034). 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51540 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode8_trial034_TCP_10.20.193.34_4420, OMAP version: 25 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:41.910 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode9 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:41.932 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:41.932 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:27:41.933 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:41.933 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:41.933 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode10 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:41.966 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:42.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:41] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:39586 2026-02-18T03:27:42.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:41] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode9_trial034_TCP_10.20.193.34_4420, OMAP version: 26 2026-02-18T03:27:42.458 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode10 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:42.478 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:42.478 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:27:42.478 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:42.479 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:42.479 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode11 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:42.517 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:1684 (141): Start update from 24 to 26 (discovery-trial086). 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:2068 (141): Update complete (24 -> 26) (discovery-trial086). 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 24 to 26 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:42.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (24 -> 26) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:42.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 24 to 26 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:42.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:42.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (24 -> 26) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:1684 (129): Start update from 24 to 26 (discovery-trial177). 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:2068 (129): Update complete (24 -> 26) (discovery-trial177). 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:1684 (108): Start update from 24 to 26 (discovery-trial155). 2026-02-18T03:27:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:2068 (108): Update complete (24 -> 26) (discovery-trial155). 2026-02-18T03:27:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 24 to 26 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (24 -> 26) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:1684 (84): Start update from 24 to 26 (discovery-trial034). 2026-02-18T03:27:42.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:2068 (84): Update complete (24 -> 26) (discovery-trial034). 2026-02-18T03:27:42.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:49500 2026-02-18T03:27:42.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:42.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode10_trial034_TCP_10.20.193.34_4420, OMAP version: 27 2026-02-18T03:27:42.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:42.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:43.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:43.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:1684 (129): Start update from 26 to 27 (discovery-trial177). 2026-02-18T03:27:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:42] INFO state.py:2068 (129): Update complete (26 -> 27) (discovery-trial177). 2026-02-18T03:27:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-mon[24719]: pgmap v137: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 89 KiB/s rd, 3.2 KiB/s wr, 88 op/s 2026-02-18T03:27:43.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:1684 (108): Start update from 26 to 27 (discovery-trial155). 2026-02-18T03:27:43.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:2068 (108): Update complete (26 -> 27) (discovery-trial155). 2026-02-18T03:27:43.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-mon[21825]: pgmap v137: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 89 KiB/s rd, 3.2 KiB/s wr, 88 op/s 2026-02-18T03:27:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:52904 2026-02-18T03:27:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:1684 (84): Start update from 26 to 27 (discovery-trial034). 2026-02-18T03:27:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:42] INFO state.py:2068 (84): Update complete (26 -> 27) (discovery-trial034). 2026-02-18T03:27:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-mon[24100]: pgmap v137: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 89 KiB/s rd, 3.2 KiB/s wr, 88 op/s 2026-02-18T03:27:43.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:1684 (141): Start update from 26 to 27 (discovery-trial086). 2026-02-18T03:27:43.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:2068 (141): Update complete (26 -> 27) (discovery-trial086). 2026-02-18T03:27:43.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:1684 (2): Start update from 26 to 27 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:43.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:42] INFO state.py:2068 (2): Update complete (26 -> 27) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:44.022 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode11 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:44.043 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:44.044 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:27:44.044 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:44.044 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:44.045 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode12 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:44.087 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:44.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:43 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/467825940' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:43 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3212806906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:43 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1640998512' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:43 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/467825940' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:43 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3212806906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:43 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1640998512' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:43] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 2 retries 2026-02-18T03:27:44.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode11_trial034_TCP_10.20.193.34_4420, OMAP version: 28 2026-02-18T03:27:44.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:43 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/467825940' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:43 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3212806906' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:43 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1640998512' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:44.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.581 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode12 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:44.602 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:44.602 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:27:44.603 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:44.603 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:44.603 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode13 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:44.645 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:44.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO state.py:1684 (141): Start update from 27 to 28 (discovery-trial086). 2026-02-18T03:27:44.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO state.py:2068 (141): Update complete (27 -> 28) (discovery-trial086). 2026-02-18T03:27:44.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:44.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:44.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:44.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:44.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] INFO state.py:1684 (84): Start update from 27 to 28 (discovery-trial034). 2026-02-18T03:27:44.949 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] INFO state.py:2068 (84): Update complete (27 -> 28) (discovery-trial034). 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:57866 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode12_trial034_TCP_10.20.193.34_4420, OMAP version: 29 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:44] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO state.py:1684 (108): Start update from 27 to 28 (discovery-trial155). 2026-02-18T03:27:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO state.py:2068 (108): Update complete (27 -> 28) (discovery-trial155). 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO state.py:1684 (2): Start update from 27 to 28 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO state.py:2068 (2): Update complete (27 -> 28) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO state.py:1684 (129): Start update from 27 to 28 (discovery-trial177). 2026-02-18T03:27:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] INFO state.py:2068 (129): Update complete (27 -> 28) (discovery-trial177). 2026-02-18T03:27:44.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:44.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:44] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:44 trial155 ceph-mon[24719]: pgmap v138: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 63 KiB/s rd, 2.2 KiB/s wr, 56 op/s 2026-02-18T03:27:45.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO state.py:1684 (108): Start update from 28 to 29 (discovery-trial155). 2026-02-18T03:27:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO state.py:2068 (108): Update complete (28 -> 29) (discovery-trial155). 2026-02-18T03:27:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:45] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:44 trial034 ceph-mon[21825]: pgmap v138: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 63 KiB/s rd, 2.2 KiB/s wr, 56 op/s 2026-02-18T03:27:45.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:45] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:55898 2026-02-18T03:27:45.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:45.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:45] INFO state.py:1684 (84): Start update from 28 to 29 (discovery-trial034). 2026-02-18T03:27:45.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:45] INFO state.py:2068 (84): Update complete (28 -> 29) (discovery-trial034). 2026-02-18T03:27:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:44 trial086 ceph-mon[24100]: pgmap v138: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 63 KiB/s rd, 2.2 KiB/s wr, 56 op/s 2026-02-18T03:27:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO state.py:1684 (141): Start update from 28 to 29 (discovery-trial086). 2026-02-18T03:27:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO state.py:2068 (141): Update complete (28 -> 29) (discovery-trial086). 2026-02-18T03:27:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:45] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO state.py:1684 (2): Start update from 28 to 29 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO state.py:2068 (2): Update complete (28 -> 29) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO state.py:1684 (129): Start update from 28 to 29 (discovery-trial177). 2026-02-18T03:27:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:45] INFO state.py:2068 (129): Update complete (28 -> 29) (discovery-trial177). 2026-02-18T03:27:46.137 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode13 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:46.160 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:46.160 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:27:46.160 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:46.160 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:46.161 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode14 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:46.205 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:46.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3199986932' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:46.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3199986932' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode13_trial034_TCP_10.20.193.34_4420, OMAP version: 30 2026-02-18T03:27:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:45 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3199986932' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:46.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:46.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:57420 2026-02-18T03:27:46.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:46.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] INFO state.py:1684 (84): Start update from 29 to 30 (discovery-trial034). 2026-02-18T03:27:46.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:46] INFO state.py:2068 (84): Update complete (29 -> 30) (discovery-trial034). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO state.py:1684 (141): Start update from 29 to 30 (discovery-trial086). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO state.py:2068 (141): Update complete (29 -> 30) (discovery-trial086). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:46] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO state.py:1684 (108): Start update from 29 to 30 (discovery-trial155). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO state.py:2068 (108): Update complete (29 -> 30) (discovery-trial155). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:46.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:46] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:46.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO state.py:1684 (2): Start update from 29 to 30 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:46.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:46.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:46.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO state.py:2068 (2): Update complete (29 -> 30) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:46.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO state.py:1684 (129): Start update from 29 to 30 (discovery-trial177). 2026-02-18T03:27:46.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:46] INFO state.py:2068 (129): Update complete (29 -> 30) (discovery-trial177). 2026-02-18T03:27:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:46 trial155 ceph-mon[24719]: pgmap v139: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 119 KiB/s rd, 3.3 KiB/s wr, 93 op/s 2026-02-18T03:27:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:46 trial034 ceph-mon[21825]: pgmap v139: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 119 KiB/s rd, 3.3 KiB/s wr, 93 op/s 2026-02-18T03:27:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:46 trial086 ceph-mon[24100]: pgmap v139: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 119 KiB/s rd, 3.3 KiB/s wr, 93 op/s 2026-02-18T03:27:47.693 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode14 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:47.715 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:47.715 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:27:47.715 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:47.715 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:47.716 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode15 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:47.748 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:47.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:47.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:47] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:47.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:47] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:47.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:48.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:47] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:48.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:47] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode14_trial034_TCP_10.20.193.34_4420, OMAP version: 31 2026-02-18T03:27:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:47] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:48.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:47] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:48.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:48.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:48.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:48.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO state.py:1684 (129): Start update from 30 to 31 (discovery-trial177). 2026-02-18T03:27:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:48] INFO state.py:2068 (129): Update complete (30 -> 31) (discovery-trial177). 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO state.py:1684 (108): Start update from 30 to 31 (discovery-trial155). 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO state.py:2068 (108): Update complete (30 -> 31) (discovery-trial155). 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:48.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:48] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:48.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:48] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:39976 2026-02-18T03:27:48.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:48.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:48] INFO state.py:1684 (84): Start update from 30 to 31 (discovery-trial034). 2026-02-18T03:27:48.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:48] INFO state.py:2068 (84): Update complete (30 -> 31) (discovery-trial034). 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO state.py:1684 (141): Start update from 30 to 31 (discovery-trial086). 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO state.py:2068 (141): Update complete (30 -> 31) (discovery-trial086). 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO state.py:1684 (2): Start update from 30 to 31 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:48] INFO state.py:2068 (2): Update complete (30 -> 31) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:48 trial155 ceph-mon[24719]: pgmap v140: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:49.244 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:48 trial034 ceph-mon[21825]: pgmap v140: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:49.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:49.244 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode15_trial034_TCP_10.20.193.34_4420, OMAP version: 32 2026-02-18T03:27:49.245 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:48 trial086 ceph-mon[24100]: pgmap v140: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:49.249 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode15 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:49.272 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:49.273 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:27:49.273 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.34 and name trial034' 2026-02-18T03:27:49.273 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.34 and name trial034 2026-02-18T03:27:49.273 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode16 --host-name trial034 --traddr 10.20.193.34 --trsvcid 4420 2026-02-18T03:27:49.319 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:49Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:49.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:50.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:33594 2026-02-18T03:27:50.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:50.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] INFO state.py:1684 (84): Start update from 31 to 32 (discovery-trial034). 2026-02-18T03:27:50.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:49] INFO state.py:2068 (84): Update complete (31 -> 32) (discovery-trial034). 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO state.py:1684 (141): Start update from 31 to 32 (discovery-trial086). 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO state.py:2068 (141): Update complete (31 -> 32) (discovery-trial086). 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:50.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:49] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO state.py:1684 (129): Start update from 31 to 32 (discovery-trial177). 2026-02-18T03:27:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:49] INFO state.py:2068 (129): Update complete (31 -> 32) (discovery-trial177). 2026-02-18T03:27:50.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO state.py:1684 (108): Start update from 31 to 32 (discovery-trial155). 2026-02-18T03:27:50.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO state.py:2068 (108): Update complete (31 -> 32) (discovery-trial155). 2026-02-18T03:27:50.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO state.py:1684 (2): Start update from 31 to 32 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:49] INFO state.py:2068 (2): Update complete (31 -> 32) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:50.809 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode16 listener at 10.20.193.34:4420: Successful 2026-02-18T03:27:50.831 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:27:50.831 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.86 2026-02-18T03:27:50.831 INFO:tasks.workunit.client.0.trial014.stderr:+ name=trial086 2026-02-18T03:27:50.832 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:27:50.833 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:50.833 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:27:50.833 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:50.833 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:50.833 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:50.871 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:51.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-mon[21825]: pgmap v141: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:51.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/151994792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1402895957' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3253885775' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:50] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:51.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:50] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode16_trial034_TCP_10.20.193.34_4420, OMAP version: 33 2026-02-18T03:27:51.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:50] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:50] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-mon[24100]: pgmap v141: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:51.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/151994792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1402895957' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:50 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3253885775' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:50] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-mon[24719]: pgmap v141: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 95 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:27:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/151994792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1402895957' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3253885775' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:51.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:50] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.356 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:51.375 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:51.375 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:27:51.375 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:51.376 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:51.376 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:51.412 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:1684 (141): Start update from 32 to 33 (discovery-trial086). 2026-02-18T03:27:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:2068 (141): Update complete (32 -> 33) (discovery-trial086). 2026-02-18T03:27:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:53486 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:27:51.337695] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.86 port 4420 *** 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial086_TCP_10.20.193.86_4420, OMAP version: 34 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:27:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:1684 (129): Start update from 32 to 33 (discovery-trial177). 2026-02-18T03:27:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:2068 (129): Update complete (32 -> 33) (discovery-trial177). 2026-02-18T03:27:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:1684 (108): Start update from 32 to 33 (discovery-trial155). 2026-02-18T03:27:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:2068 (108): Update complete (32 -> 33) (discovery-trial155). 2026-02-18T03:27:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 32 to 33 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:27:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (32 -> 33) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:1684 (84): Start update from 32 to 33 (discovery-trial034). 2026-02-18T03:27:51.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:2068 (84): Update complete (32 -> 33) (discovery-trial034). 2026-02-18T03:27:51.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:51.892 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:51.916 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:51.916 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:51.916 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:27:51.916 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:51.916 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:51.944 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:52.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:1684 (141): Start update from 33 to 34 (discovery-trial086). 2026-02-18T03:27:52.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:2068 (141): Update complete (33 -> 34) (discovery-trial086). 2026-02-18T03:27:52.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:34482 2026-02-18T03:27:52.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:52.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial086_TCP_10.20.193.86_4420, OMAP version: 35 2026-02-18T03:27:52.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:52.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:52.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:52.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:52.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:1684 (129): Start update from 33 to 34 (discovery-trial177). 2026-02-18T03:27:52.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] INFO state.py:2068 (129): Update complete (33 -> 34) (discovery-trial177). 2026-02-18T03:27:52.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:51] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:1684 (108): Start update from 33 to 34 (discovery-trial155). 2026-02-18T03:27:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:2068 (108): Update complete (33 -> 34) (discovery-trial155). 2026-02-18T03:27:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:52.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:1684 (2): Start update from 33 to 34 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:2068 (2): Update complete (33 -> 34) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:1684 (84): Start update from 33 to 34 (discovery-trial034). 2026-02-18T03:27:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] INFO state.py:2068 (84): Update complete (33 -> 34) (discovery-trial034). 2026-02-18T03:27:52.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:51] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.396 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:52.415 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:52.416 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:27:52.416 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:52.417 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:52.417 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode4 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:52.455 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:50140 2026-02-18T03:27:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial086_TCP_10.20.193.86_4420, OMAP version: 36 2026-02-18T03:27:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO state.py:1684 (2): Start update from 34 to 36 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO state.py:2068 (2): Update complete (34 -> 36) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO state.py:1684 (129): Start update from 34 to 36 (discovery-trial177). 2026-02-18T03:27:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:52] INFO state.py:2068 (129): Update complete (34 -> 36) (discovery-trial177). 2026-02-18T03:27:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-mon[24719]: pgmap v142: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 118 KiB/s rd, 2.8 KiB/s wr, 83 op/s 2026-02-18T03:27:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO state.py:1684 (108): Start update from 34 to 36 (discovery-trial155). 2026-02-18T03:27:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO state.py:2068 (108): Update complete (34 -> 36) (discovery-trial155). 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO state.py:1684 (2): Start update from 34 to 36 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:52] INFO state.py:2068 (2): Update complete (34 -> 36) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-mon[21825]: pgmap v142: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 118 KiB/s rd, 2.8 KiB/s wr, 83 op/s 2026-02-18T03:27:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO state.py:1684 (2): Start update from 34 to 36 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO state.py:2068 (2): Update complete (34 -> 36) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO state.py:1684 (84): Start update from 34 to 36 (discovery-trial034). 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO state.py:2068 (84): Update complete (34 -> 36) (discovery-trial034). 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:52] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 2 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:27:53.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: ], , client address: IPv4 10.20.193.34:33898 2026-02-18T03:27:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-mon[24100]: pgmap v142: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 118 KiB/s rd, 2.8 KiB/s wr, 83 op/s 2026-02-18T03:27:53.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] INFO state.py:1684 (141): Start update from 34 to 36 (discovery-trial086). 2026-02-18T03:27:53.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] INFO state.py:2068 (141): Update complete (34 -> 36) (discovery-trial086). 2026-02-18T03:27:53.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:52654 2026-02-18T03:27:53.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:53.937 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode4 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:53.960 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:53.961 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:27:53.961 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:53.962 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:53.962 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode5 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:53.999 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:54.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:53] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:53 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/566360050' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:53] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/566360050' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:53] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:53 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/566360050' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:54.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:53] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:54.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:53] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode4_trial086_TCP_10.20.193.86_4420, OMAP version: 37 2026-02-18T03:27:54.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:53] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.449 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode5 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:54.470 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:54.470 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:27:54.470 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:54.470 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:54.470 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode6 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:54.503 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:54.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:52242 2026-02-18T03:27:54.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:54.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode5_trial086_TCP_10.20.193.86_4420, OMAP version: 38 2026-02-18T03:27:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO state.py:1684 (2): Start update from 36 to 38 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO state.py:2068 (2): Update complete (36 -> 38) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO state.py:1684 (129): Start update from 36 to 38 (discovery-trial177). 2026-02-18T03:27:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:54] INFO state.py:2068 (129): Update complete (36 -> 38) (discovery-trial177). 2026-02-18T03:27:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-mon[24719]: pgmap v143: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:27:55.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO state.py:1684 (108): Start update from 36 to 38 (discovery-trial155). 2026-02-18T03:27:55.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO state.py:2068 (108): Update complete (36 -> 38) (discovery-trial155). 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO state.py:1684 (2): Start update from 36 to 38 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:55.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:54] INFO state.py:2068 (2): Update complete (36 -> 38) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-mon[21825]: pgmap v143: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO state.py:1684 (2): Start update from 36 to 38 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO state.py:2068 (2): Update complete (36 -> 38) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO state.py:1684 (84): Start update from 36 to 38 (discovery-trial034). 2026-02-18T03:27:55.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:54] INFO state.py:2068 (84): Update complete (36 -> 38) (discovery-trial034). 2026-02-18T03:27:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-mon[24100]: pgmap v143: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 79 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:27:55.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:57316 2026-02-18T03:27:55.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:55.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] INFO state.py:1684 (141): Start update from 36 to 38 (discovery-trial086). 2026-02-18T03:27:55.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:54] INFO state.py:2068 (141): Update complete (36 -> 38) (discovery-trial086). 2026-02-18T03:27:55.969 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode6 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:55.990 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:55.990 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:27:55.990 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:55.990 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:55.990 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode7 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:56.024 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:56.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:55] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:55] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:55] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:55] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode6_trial086_TCP_10.20.193.86_4420, OMAP version: 39 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:55] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:55] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: states { 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: grp_id: 2 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: state: OPTIMIZED 2026-02-18T03:27:56.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: } 2026-02-18T03:27:56.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: ], , client address: IPv4 10.20.193.86:57488 2026-02-18T03:27:56.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:55] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO state.py:1684 (108): Start update from 38 to 39 (discovery-trial155). 2026-02-18T03:27:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO state.py:2068 (108): Update complete (38 -> 39) (discovery-trial155). 2026-02-18T03:27:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:56] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:56.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:56.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:56.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:56.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:56.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO state.py:1684 (84): Start update from 38 to 39 (discovery-trial034). 2026-02-18T03:27:56.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:56] INFO state.py:2068 (84): Update complete (38 -> 39) (discovery-trial034). 2026-02-18T03:27:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:56] INFO state.py:1684 (141): Start update from 38 to 39 (discovery-trial086). 2026-02-18T03:27:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:56] INFO state.py:2068 (141): Update complete (38 -> 39) (discovery-trial086). 2026-02-18T03:27:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:56] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:57120 2026-02-18T03:27:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:27:56.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO state.py:1684 (2): Start update from 38 to 39 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:56.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:56.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:56.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO state.py:2068 (2): Update complete (38 -> 39) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:56.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO state.py:1684 (129): Start update from 38 to 39 (discovery-trial177). 2026-02-18T03:27:56.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:56] INFO state.py:2068 (129): Update complete (38 -> 39) (discovery-trial177). 2026-02-18T03:27:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:56 trial155 ceph-mon[24719]: pgmap v144: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:27:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:56 trial034 ceph-mon[21825]: pgmap v144: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:27:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:56 trial086 ceph-mon[24100]: pgmap v144: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:27:57.509 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode7 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:57.534 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:57.534 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:27:57.534 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:57.534 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:57.535 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode8 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:57.577 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:57Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:57.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:57] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:57] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 2 retries 2026-02-18T03:27:57.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:57] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode7_trial086_TCP_10.20.193.86_4420, OMAP version: 40 2026-02-18T03:27:57.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:57] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:57] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:57] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:57.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.025 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode8 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:58.046 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:58.046 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:27:58.046 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:58.046 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:58.046 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode9 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:58.094 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:57 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/4116723430' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:57 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/328332414' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:58] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4116723430' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/328332414' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:58] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/4116723430' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/328332414' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:27:58.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:57] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:47600 2026-02-18T03:27:58.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode8_trial086_TCP_10.20.193.86_4420, OMAP version: 41 2026-02-18T03:27:58.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:58] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.525 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode9 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:58.550 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:58.550 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:27:58.551 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:58.551 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:58.551 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode10 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:58.597 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:58] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:35344 2026-02-18T03:27:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:58] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode9_trial086_TCP_10.20.193.86_4420, OMAP version: 42 2026-02-18T03:27:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:58] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:58] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:58.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.070 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode10 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:59.090 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:59.090 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:27:59.091 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:59.091 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:59.091 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode11 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:59.129 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:59Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:58 trial034 ceph-mon[21825]: pgmap v145: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 39 to 42 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (39 -> 42) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:1684 (84): Start update from 39 to 42 (discovery-trial034). 2026-02-18T03:27:59.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:2068 (84): Update complete (39 -> 42) (discovery-trial034). 2026-02-18T03:27:59.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:58 trial086 ceph-mon[24100]: pgmap v145: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:27:59.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:1684 (141): Start update from 39 to 42 (discovery-trial086). 2026-02-18T03:27:59.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:2068 (141): Update complete (39 -> 42) (discovery-trial086). 2026-02-18T03:27:59.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:58948 2026-02-18T03:27:59.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:59.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode10_trial086_TCP_10.20.193.86_4420, OMAP version: 43 2026-02-18T03:27:59.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 39 to 42 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:59.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (39 -> 42) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:1684 (129): Start update from 39 to 42 (discovery-trial177). 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:2068 (129): Update complete (39 -> 42) (discovery-trial177). 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:58 trial155 ceph-mon[24719]: pgmap v145: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:27:59.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:1684 (108): Start update from 39 to 42 (discovery-trial155). 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:2068 (108): Update complete (39 -> 42) (discovery-trial155). 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 39 to 42 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (39 -> 42) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.617 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode11 listener at 10.20.193.86:4420: Successful 2026-02-18T03:27:59.636 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:27:59.636 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:27:59.637 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:27:59.637 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:27:59.637 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode12 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:27:59.675 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:27:59Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:27:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:1684 (141): Start update from 42 to 43 (discovery-trial086). 2026-02-18T03:27:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:2068 (141): Update complete (42 -> 43) (discovery-trial086). 2026-02-18T03:27:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:45574 2026-02-18T03:27:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:27:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode11_trial086_TCP_10.20.193.86_4420, OMAP version: 44 2026-02-18T03:27:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:59.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:27:59.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:27:59.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:1684 (129): Start update from 42 to 43 (discovery-trial177). 2026-02-18T03:27:59.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] INFO state.py:2068 (129): Update complete (42 -> 43) (discovery-trial177). 2026-02-18T03:27:59.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:27:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:27:59] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:1684 (108): Start update from 42 to 43 (discovery-trial155). 2026-02-18T03:27:59.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:2068 (108): Update complete (42 -> 43) (discovery-trial155). 2026-02-18T03:27:59.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:59.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:27:59.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:27:59.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:1684 (2): Start update from 42 to 43 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:2068 (2): Update complete (42 -> 43) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:1684 (84): Start update from 42 to 43 (discovery-trial034). 2026-02-18T03:27:59.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] INFO state.py:2068 (84): Update complete (42 -> 43) (discovery-trial034). 2026-02-18T03:27:59.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:27:59.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:27:59] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.161 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode12 listener at 10.20.193.86:4420: Successful 2026-02-18T03:28:00.181 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:00.182 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:28:00.182 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:28:00.183 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:28:00.183 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode13 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:28:00.214 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:27:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4001018764' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO state.py:1684 (84): Start update from 43 to 44 (discovery-trial034). 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] INFO state.py:2068 (84): Update complete (43 -> 44) (discovery-trial034). 2026-02-18T03:28:00.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:27:59 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4001018764' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO state.py:1684 (141): Start update from 43 to 44 (discovery-trial086). 2026-02-18T03:28:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO state.py:2068 (141): Update complete (43 -> 44) (discovery-trial086). 2026-02-18T03:28:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:45928 2026-02-18T03:28:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode12_trial086_TCP_10.20.193.86_4420, OMAP version: 45 2026-02-18T03:28:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:00.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO state.py:1684 (129): Start update from 43 to 44 (discovery-trial177). 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] INFO state.py:2068 (129): Update complete (43 -> 44) (discovery-trial177). 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:27:59 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4001018764' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:00.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO state.py:1684 (108): Start update from 43 to 44 (discovery-trial155). 2026-02-18T03:28:00.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO state.py:2068 (108): Update complete (43 -> 44) (discovery-trial155). 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO state.py:1684 (2): Start update from 43 to 44 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] INFO state.py:2068 (2): Update complete (43 -> 44) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.665 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode13 listener at 10.20.193.86:4420: Successful 2026-02-18T03:28:00.686 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:00.686 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:28:00.687 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:28:00.687 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:28:00.687 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode14 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:28:00.719 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:00] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.985 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:00] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:40826 2026-02-18T03:28:00.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:00.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:00] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode13_trial086_TCP_10.20.193.86_4420, OMAP version: 46 2026-02-18T03:28:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:00 trial034 ceph-mon[21825]: pgmap v146: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO state.py:1684 (2): Start update from 44 to 46 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:01.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO state.py:2068 (2): Update complete (44 -> 46) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:01.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO state.py:1684 (84): Start update from 44 to 46 (discovery-trial034). 2026-02-18T03:28:01.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:01] INFO state.py:2068 (84): Update complete (44 -> 46) (discovery-trial034). 2026-02-18T03:28:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:00 trial086 ceph-mon[24100]: pgmap v146: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:01.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:01] INFO state.py:1684 (141): Start update from 44 to 46 (discovery-trial086). 2026-02-18T03:28:01.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:01] INFO state.py:2068 (141): Update complete (44 -> 46) (discovery-trial086). 2026-02-18T03:28:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:58728 2026-02-18T03:28:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO state.py:1684 (2): Start update from 44 to 46 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO state.py:2068 (2): Update complete (44 -> 46) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO state.py:1684 (129): Start update from 44 to 46 (discovery-trial177). 2026-02-18T03:28:01.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:01] INFO state.py:2068 (129): Update complete (44 -> 46) (discovery-trial177). 2026-02-18T03:28:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:00 trial155 ceph-mon[24719]: pgmap v146: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:01.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO state.py:1684 (108): Start update from 44 to 46 (discovery-trial155). 2026-02-18T03:28:01.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO state.py:2068 (108): Update complete (44 -> 46) (discovery-trial155). 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO state.py:1684 (2): Start update from 44 to 46 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:01.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:01] INFO state.py:2068 (2): Update complete (44 -> 46) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:02.213 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode14 listener at 10.20.193.86:4420: Successful 2026-02-18T03:28:02.236 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:02.236 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:28:02.237 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:28:02.237 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:28:02.237 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode15 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:28:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1398673198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.275 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:02Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:01 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/1398673198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode14_trial086_TCP_10.20.193.86_4420, OMAP version: 47 2026-02-18T03:28:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:01 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1398673198' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:02.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.801 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode15 listener at 10.20.193.86:4420: Successful 2026-02-18T03:28:02.822 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:02.822 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:28:02.822 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.86 and name trial086 2026-02-18T03:28:02.823 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.86 and name trial086' 2026-02-18T03:28:02.823 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode16 --host-name trial086 --traddr 10.20.193.86 --trsvcid 4420 2026-02-18T03:28:02.867 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:02Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO state.py:1684 (108): Start update from 46 to 47 (discovery-trial155). 2026-02-18T03:28:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO state.py:2068 (108): Update complete (46 -> 47) (discovery-trial155). 2026-02-18T03:28:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO state.py:1684 (84): Start update from 46 to 47 (discovery-trial034). 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] INFO state.py:2068 (84): Update complete (46 -> 47) (discovery-trial034). 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.989 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:02] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:1684 (141): Start update from 46 to 47 (discovery-trial086). 2026-02-18T03:28:02.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:2068 (141): Update complete (46 -> 47) (discovery-trial086). 2026-02-18T03:28:02.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:46488 2026-02-18T03:28:02.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:02.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode15_trial086_TCP_10.20.193.86_4420, OMAP version: 48 2026-02-18T03:28:02.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:02.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:02] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO state.py:1684 (2): Start update from 46 to 47 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO state.py:2068 (2): Update complete (46 -> 47) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO state.py:1684 (129): Start update from 46 to 47 (discovery-trial177). 2026-02-18T03:28:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] INFO state.py:2068 (129): Update complete (46 -> 47) (discovery-trial177). 2026-02-18T03:28:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:02] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: pgmap v147: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 114 KiB/s rd, 2.5 KiB/s wr, 61 op/s 2026-02-18T03:28:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:28:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: pgmap v147: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 114 KiB/s rd, 2.5 KiB/s wr, 61 op/s 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:28:03.281 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:02 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:03.299 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: pgmap v147: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 114 KiB/s rd, 2.5 KiB/s wr, 61 op/s 2026-02-18T03:28:03.299 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:28:03.299 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:28:03.299 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:28:03.300 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:28:03.300 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:02 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:28:03.310 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode16 listener at 10.20.193.86:4420: Successful 2026-02-18T03:28:03.331 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:28:03.331 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.155 2026-02-18T03:28:03.331 INFO:tasks.workunit.client.0.trial014.stderr:+ name=trial155 2026-02-18T03:28:03.331 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:28:03.332 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:03.332 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:28:03.332 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:03.333 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:03.333 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:03.377 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:03.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:33926 2026-02-18T03:28:03.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode16_trial086_TCP_10.20.193.86_4420, OMAP version: 49 2026-02-18T03:28:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:03.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:04.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] INFO state.py:1684 (141): Start update from 47 to 49 (discovery-trial086). 2026-02-18T03:28:04.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:03] INFO state.py:2068 (141): Update complete (47 -> 49) (discovery-trial086). 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO state.py:1684 (2): Start update from 47 to 49 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO state.py:2068 (2): Update complete (47 -> 49) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:04.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO state.py:1684 (129): Start update from 47 to 49 (discovery-trial177). 2026-02-18T03:28:04.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:03] INFO state.py:2068 (129): Update complete (47 -> 49) (discovery-trial177). 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:48114 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO state.py:1684 (108): Start update from 47 to 49 (discovery-trial155). 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO state.py:2068 (108): Update complete (47 -> 49) (discovery-trial155). 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO state.py:1684 (2): Start update from 47 to 49 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:04.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:28:04.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:03] INFO state.py:2068 (2): Update complete (47 -> 49) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:04.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO state.py:1684 (2): Start update from 47 to 49 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:04.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:04.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:04.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:28:04.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO state.py:2068 (2): Update complete (47 -> 49) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:04.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO state.py:1684 (84): Start update from 47 to 49 (discovery-trial034). 2026-02-18T03:28:04.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:03] INFO state.py:2068 (84): Update complete (47 -> 49) (discovery-trial034). 2026-02-18T03:28:04.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:04 trial034 ceph-mon[21825]: pgmap v148: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:04.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/347965699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3815346864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-mon[24719]: pgmap v148: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:04.811 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/347965699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.811 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3815346864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.831 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:04 trial086 ceph-mon[24100]: pgmap v148: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 91 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:04.831 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:04 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/347965699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.831 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:04 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3815346864' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:04.836 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:04.858 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:04.858 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:28:04.858 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:04.859 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:04.859 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:04.897 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:04Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:04] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:04] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:04] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:04.815509] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.155 port 4420 *** 2026-02-18T03:28:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:04] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial155_TCP_10.20.193.155_4420, OMAP version: 50 2026-02-18T03:28:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:04] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:04] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.367 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:05.387 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:05.387 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:28:05.388 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:05.388 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:05.388 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:05.424 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:1684 (141): Start update from 49 to 50 (discovery-trial086). 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:2068 (141): Update complete (49 -> 50) (discovery-trial086). 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:05.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:05.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:05.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:1684 (129): Start update from 49 to 50 (discovery-trial177). 2026-02-18T03:28:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:2068 (129): Update complete (49 -> 50) (discovery-trial177). 2026-02-18T03:28:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:1684 (108): Start update from 49 to 50 (discovery-trial155). 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:2068 (108): Update complete (49 -> 50) (discovery-trial155). 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:37078 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial155_TCP_10.20.193.155_4420, OMAP version: 51 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 49 to 50 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:05.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (49 -> 50) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:1684 (84): Start update from 49 to 50 (discovery-trial034). 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:2068 (84): Update complete (49 -> 50) (discovery-trial034). 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:05.899 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:05.919 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:05.919 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:28:05.919 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:05.919 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:05.920 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode4 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:05.954 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:1684 (141): Start update from 50 to 51 (discovery-trial086). 2026-02-18T03:28:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:2068 (141): Update complete (50 -> 51) (discovery-trial086). 2026-02-18T03:28:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:06.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:06.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:06.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:06.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:06.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:1684 (129): Start update from 50 to 51 (discovery-trial177). 2026-02-18T03:28:06.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] INFO state.py:2068 (129): Update complete (50 -> 51) (discovery-trial177). 2026-02-18T03:28:06.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:05] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:54618 2026-02-18T03:28:06.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:1684 (108): Start update from 50 to 51 (discovery-trial155). 2026-02-18T03:28:06.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:2068 (108): Update complete (50 -> 51) (discovery-trial155). 2026-02-18T03:28:06.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial155_TCP_10.20.193.155_4420, OMAP version: 52 2026-02-18T03:28:06.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:1684 (2): Start update from 50 to 51 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:2068 (2): Update complete (50 -> 51) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:1684 (84): Start update from 50 to 51 (discovery-trial034). 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] INFO state.py:2068 (84): Update complete (50 -> 51) (discovery-trial034). 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:05] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:06.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:06.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:06.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:06.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO state.py:1684 (129): Start update from 51 to 52 (discovery-trial177). 2026-02-18T03:28:06.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:06] INFO state.py:2068 (129): Update complete (51 -> 52) (discovery-trial177). 2026-02-18T03:28:06.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:06 trial155 ceph-mon[24719]: pgmap v149: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 155 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:06.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:06] INFO state.py:1684 (108): Start update from 51 to 52 (discovery-trial155). 2026-02-18T03:28:06.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:06] INFO state.py:2068 (108): Update complete (51 -> 52) (discovery-trial155). 2026-02-18T03:28:06.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:35006 2026-02-18T03:28:06.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:06.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-mon[21825]: pgmap v149: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 155 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:06.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:06.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO state.py:1684 (84): Start update from 51 to 52 (discovery-trial034). 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO state.py:2068 (84): Update complete (51 -> 52) (discovery-trial034). 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:06] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 3 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:06.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: ], , client address: IPv4 10.20.193.34:52972 2026-02-18T03:28:06.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-mon[24100]: pgmap v149: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 155 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO state.py:1684 (141): Start update from 51 to 52 (discovery-trial086). 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO state.py:2068 (141): Update complete (51 -> 52) (discovery-trial086). 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO state.py:1684 (2): Start update from 51 to 52 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:06.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:06] INFO state.py:2068 (2): Update complete (51 -> 52) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:07.432 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode4 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:07.454 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:07.454 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:28:07.454 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:07.455 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:07.455 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode5 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:07.492 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:07.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3634041793' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:07.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:07.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode4_trial155_TCP_10.20.193.155_4420, OMAP version: 53 2026-02-18T03:28:07.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3634041793' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:07.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3634041793' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:08.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:08.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:08.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:08.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:08.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO state.py:1684 (129): Start update from 52 to 53 (discovery-trial177). 2026-02-18T03:28:08.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:07] INFO state.py:2068 (129): Update complete (52 -> 53) (discovery-trial177). 2026-02-18T03:28:08.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:44160 2026-02-18T03:28:08.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:08.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] INFO state.py:1684 (108): Start update from 52 to 53 (discovery-trial155). 2026-02-18T03:28:08.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:07] INFO state.py:2068 (108): Update complete (52 -> 53) (discovery-trial155). 2026-02-18T03:28:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO state.py:1684 (84): Start update from 52 to 53 (discovery-trial034). 2026-02-18T03:28:08.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:07] INFO state.py:2068 (84): Update complete (52 -> 53) (discovery-trial034). 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO state.py:1684 (2): Start update from 52 to 53 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO state.py:2068 (2): Update complete (52 -> 53) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO state.py:1684 (141): Start update from 52 to 53 (discovery-trial086). 2026-02-18T03:28:08.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:07] INFO state.py:2068 (141): Update complete (52 -> 53) (discovery-trial086). 2026-02-18T03:28:08.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:08 trial034 ceph-mon[21825]: pgmap v150: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:08.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:08 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2541323877' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:08 trial086 ceph-mon[24100]: pgmap v150: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:08.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:08 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2541323877' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.936 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-mon[24719]: pgmap v150: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:08.936 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2541323877' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:08.959 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode5 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:09.181 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:09.181 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:28:09.181 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:09.182 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:09.182 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode6 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:08] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:08] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:08] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode5_trial155_TCP_10.20.193.155_4420, OMAP version: 54 2026-02-18T03:28:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:08] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.261 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:09.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:08] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:08] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO state.py:1684 (84): Start update from 53 to 54 (discovery-trial034). 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] INFO state.py:2068 (84): Update complete (53 -> 54) (discovery-trial034). 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:09] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.528 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode6 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:09.547 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:09.547 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:28:09.547 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:09.548 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:09.548 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode7 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:09.585 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:09.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO state.py:1684 (108): Start update from 53 to 54 (discovery-trial155). 2026-02-18T03:28:09.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO state.py:2068 (108): Update complete (53 -> 54) (discovery-trial155). 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:37498 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode6_trial155_TCP_10.20.193.155_4420, OMAP version: 55 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:09] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:28:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:28:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: states { 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: grp_id: 3 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: state: OPTIMIZED 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: } 2026-02-18T03:28:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: ], , client address: IPv4 10.20.193.155:39822 2026-02-18T03:28:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO state.py:1684 (141): Start update from 53 to 54 (discovery-trial086). 2026-02-18T03:28:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] INFO state.py:2068 (141): Update complete (53 -> 54) (discovery-trial086). 2026-02-18T03:28:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:09] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO state.py:1684 (2): Start update from 53 to 54 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO state.py:2068 (2): Update complete (53 -> 54) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO state.py:1684 (129): Start update from 53 to 54 (discovery-trial177). 2026-02-18T03:28:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] INFO state.py:2068 (129): Update complete (53 -> 54) (discovery-trial177). 2026-02-18T03:28:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:09] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.075 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode7 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:10.097 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:10.097 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:28:10.097 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:10.098 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:10.098 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode8 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:10.135 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO state.py:1684 (141): Start update from 54 to 55 (discovery-trial086). 2026-02-18T03:28:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] INFO state.py:2068 (141): Update complete (54 -> 55) (discovery-trial086). 2026-02-18T03:28:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:10.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO state.py:1684 (129): Start update from 54 to 55 (discovery-trial177). 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] INFO state.py:2068 (129): Update complete (54 -> 55) (discovery-trial177). 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO state.py:1684 (108): Start update from 54 to 55 (discovery-trial155). 2026-02-18T03:28:10.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO state.py:2068 (108): Update complete (54 -> 55) (discovery-trial155). 2026-02-18T03:28:10.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:60858 2026-02-18T03:28:10.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:10.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode7_trial155_TCP_10.20.193.155_4420, OMAP version: 56 2026-02-18T03:28:10.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO state.py:1684 (2): Start update from 54 to 55 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO state.py:2068 (2): Update complete (54 -> 55) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO state.py:1684 (84): Start update from 54 to 55 (discovery-trial034). 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] INFO state.py:2068 (84): Update complete (54 -> 55) (discovery-trial034). 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.583 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode8 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:10.607 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:10.608 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:28:10.608 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:10.608 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:10.608 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode9 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:10.650 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:10.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-mon[21825]: pgmap v151: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:10.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:10] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-mon[24100]: pgmap v151: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:10.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:10] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-mon[24719]: pgmap v151: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 103 KiB/s rd, 2.0 KiB/s wr, 47 op/s 2026-02-18T03:28:10.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:36886 2026-02-18T03:28:10.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:10.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:10] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode8_trial155_TCP_10.20.193.155_4420, OMAP version: 57 2026-02-18T03:28:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO state.py:1684 (141): Start update from 55 to 57 (discovery-trial086). 2026-02-18T03:28:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO state.py:2068 (141): Update complete (55 -> 57) (discovery-trial086). 2026-02-18T03:28:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO state.py:1684 (2): Start update from 55 to 57 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:11.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:11.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:11] INFO state.py:2068 (2): Update complete (55 -> 57) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO state.py:1684 (2): Start update from 55 to 57 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO state.py:2068 (2): Update complete (55 -> 57) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO state.py:1684 (129): Start update from 55 to 57 (discovery-trial177). 2026-02-18T03:28:11.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:11] INFO state.py:2068 (129): Update complete (55 -> 57) (discovery-trial177). 2026-02-18T03:28:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51798 2026-02-18T03:28:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:11] INFO state.py:1684 (108): Start update from 55 to 57 (discovery-trial155). 2026-02-18T03:28:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:11] INFO state.py:2068 (108): Update complete (55 -> 57) (discovery-trial155). 2026-02-18T03:28:11.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO state.py:1684 (2): Start update from 55 to 57 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:11.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:11.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:11.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:11.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO state.py:2068 (2): Update complete (55 -> 57) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:11.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO state.py:1684 (84): Start update from 55 to 57 (discovery-trial034). 2026-02-18T03:28:11.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:11] INFO state.py:2068 (84): Update complete (55 -> 57) (discovery-trial034). 2026-02-18T03:28:11.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/986239419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/587038179' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/986239419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:11 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/587038179' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/986239419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:11.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:11 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/587038179' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:12.116 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode9 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:12.139 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:12.139 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:28:12.139 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:12.140 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:12.140 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode10 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:12.172 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:12.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:12.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode9_trial155_TCP_10.20.193.155_4420, OMAP version: 58 2026-02-18T03:28:12.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.664 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode10 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:12.685 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:12.685 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:28:12.685 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:12.686 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:12.686 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode11 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:12.727 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:12.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-mon[21825]: pgmap v152: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 170 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO state.py:1684 (84): Start update from 57 to 58 (discovery-trial034). 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:12.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] INFO state.py:2068 (84): Update complete (57 -> 58) (discovery-trial034). 2026-02-18T03:28:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:12] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-mon[24100]: pgmap v152: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 170 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO state.py:1684 (141): Start update from 57 to 58 (discovery-trial086). 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO state.py:2068 (141): Update complete (57 -> 58) (discovery-trial086). 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO state.py:1684 (2): Start update from 57 to 58 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO state.py:2068 (2): Update complete (57 -> 58) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO state.py:1684 (129): Start update from 57 to 58 (discovery-trial177). 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] INFO state.py:2068 (129): Update complete (57 -> 58) (discovery-trial177). 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:12] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-mon[24719]: pgmap v152: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 170 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:1684 (108): Start update from 57 to 58 (discovery-trial155). 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:2068 (108): Update complete (57 -> 58) (discovery-trial155). 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:34072 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode10_trial155_TCP_10.20.193.155_4420, OMAP version: 59 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:12.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO state.py:1684 (129): Start update from 58 to 59 (discovery-trial177). 2026-02-18T03:28:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:13] INFO state.py:2068 (129): Update complete (58 -> 59) (discovery-trial177). 2026-02-18T03:28:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:35970 2026-02-18T03:28:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:13] INFO state.py:1684 (108): Start update from 58 to 59 (discovery-trial155). 2026-02-18T03:28:13.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:13] INFO state.py:2068 (108): Update complete (58 -> 59) (discovery-trial155). 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO state.py:1684 (84): Start update from 58 to 59 (discovery-trial034). 2026-02-18T03:28:13.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:13] INFO state.py:2068 (84): Update complete (58 -> 59) (discovery-trial034). 2026-02-18T03:28:13.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO state.py:1684 (141): Start update from 58 to 59 (discovery-trial086). 2026-02-18T03:28:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO state.py:2068 (141): Update complete (58 -> 59) (discovery-trial086). 2026-02-18T03:28:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO state.py:1684 (2): Start update from 58 to 59 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:13] INFO state.py:2068 (2): Update complete (58 -> 59) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:13.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:13 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1523881011' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:14.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1523881011' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:13 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1523881011' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:14.196 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode11 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:14.218 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:14.218 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:28:14.219 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:14.219 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:14.219 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode12 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:14.255 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:14.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:14.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode11_trial155_TCP_10.20.193.155_4420, OMAP version: 60 2026-02-18T03:28:14.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO state.py:1684 (129): Start update from 59 to 60 (discovery-trial177). 2026-02-18T03:28:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:14] INFO state.py:2068 (129): Update complete (59 -> 60) (discovery-trial177). 2026-02-18T03:28:14.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-mon[24719]: pgmap v153: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:28:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51320 2026-02-18T03:28:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] INFO state.py:1684 (108): Start update from 59 to 60 (discovery-trial155). 2026-02-18T03:28:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:14] INFO state.py:2068 (108): Update complete (59 -> 60) (discovery-trial155). 2026-02-18T03:28:15.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-mon[21825]: pgmap v153: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO state.py:1684 (84): Start update from 59 to 60 (discovery-trial034). 2026-02-18T03:28:15.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:14] INFO state.py:2068 (84): Update complete (59 -> 60) (discovery-trial034). 2026-02-18T03:28:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-mon[24100]: pgmap v153: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 131 KiB/s rd, 2.0 KiB/s wr, 55 op/s 2026-02-18T03:28:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO state.py:1684 (141): Start update from 59 to 60 (discovery-trial086). 2026-02-18T03:28:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO state.py:2068 (141): Update complete (59 -> 60) (discovery-trial086). 2026-02-18T03:28:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO state.py:1684 (2): Start update from 59 to 60 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:14] INFO state.py:2068 (2): Update complete (59 -> 60) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:15.728 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode12 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:15.749 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:15.749 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:28:15.749 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:15.750 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:15.750 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode13 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:15.783 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:15.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2189746479' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:15.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:15] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:15.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:15] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode12_trial155_TCP_10.20.193.155_4420, OMAP version: 61 2026-02-18T03:28:15.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:15] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:15.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2189746479' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:15] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:15 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2189746479' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:15] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:15] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.267 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode13 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:16.287 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:16.288 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:28:16.288 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:16.288 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:16.288 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode14 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:16.325 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:16.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:1684 (84): Start update from 60 to 61 (discovery-trial034). 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:2068 (84): Update complete (60 -> 61) (discovery-trial034). 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:1684 (141): Start update from 60 to 61 (discovery-trial086). 2026-02-18T03:28:16.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:2068 (141): Update complete (60 -> 61) (discovery-trial086). 2026-02-18T03:28:16.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:16.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:16.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:16.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:16.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:1684 (108): Start update from 60 to 61 (discovery-trial155). 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:2068 (108): Update complete (60 -> 61) (discovery-trial155). 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51410 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode13_trial155_TCP_10.20.193.155_4420, OMAP version: 62 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 60 to 61 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:16.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:16.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:16.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (60 -> 61) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:16.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:1684 (129): Start update from 60 to 61 (discovery-trial177). 2026-02-18T03:28:16.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:2068 (129): Update complete (60 -> 61) (discovery-trial177). 2026-02-18T03:28:16.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:16.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-mon[24719]: pgmap v154: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 192 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:28:16.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51176 2026-02-18T03:28:16.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:16.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:1684 (108): Start update from 61 to 62 (discovery-trial155). 2026-02-18T03:28:16.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:16] INFO state.py:2068 (108): Update complete (61 -> 62) (discovery-trial155). 2026-02-18T03:28:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-mon[21825]: pgmap v154: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 192 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:1684 (84): Start update from 61 to 62 (discovery-trial034). 2026-02-18T03:28:17.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:16] INFO state.py:2068 (84): Update complete (61 -> 62) (discovery-trial034). 2026-02-18T03:28:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-mon[24100]: pgmap v154: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 192 KiB/s rd, 2.7 KiB/s wr, 78 op/s 2026-02-18T03:28:17.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:1684 (141): Start update from 61 to 62 (discovery-trial086). 2026-02-18T03:28:17.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:2068 (141): Update complete (61 -> 62) (discovery-trial086). 2026-02-18T03:28:17.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:17.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:17.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:17.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:17.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:1684 (2): Start update from 61 to 62 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:17.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:17.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:17.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:1684 (129): Start update from 61 to 62 (discovery-trial177). 2026-02-18T03:28:17.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:2068 (2): Update complete (61 -> 62) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:17.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:16] INFO state.py:2068 (129): Update complete (61 -> 62) (discovery-trial177). 2026-02-18T03:28:17.804 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode14 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:17.824 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:17.824 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:28:17.825 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:17.825 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:17.825 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode15 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:17.861 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:17Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:18.122 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:17] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:17] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:17] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:18.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:17] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode14_trial155_TCP_10.20.193.155_4420, OMAP version: 63 2026-02-18T03:28:18.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:17] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:17] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:18.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:18.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:18.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:18.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:18.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO state.py:1684 (141): Start update from 62 to 63 (discovery-trial086). 2026-02-18T03:28:18.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:18] INFO state.py:2068 (141): Update complete (62 -> 63) (discovery-trial086). 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO state.py:1684 (129): Start update from 62 to 63 (discovery-trial177). 2026-02-18T03:28:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:18] INFO state.py:2068 (129): Update complete (62 -> 63) (discovery-trial177). 2026-02-18T03:28:18.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:18] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:37854 2026-02-18T03:28:18.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:18.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:18] INFO state.py:1684 (108): Start update from 62 to 63 (discovery-trial155). 2026-02-18T03:28:18.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:18] INFO state.py:2068 (108): Update complete (62 -> 63) (discovery-trial155). 2026-02-18T03:28:18.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO state.py:1684 (2): Start update from 62 to 63 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:18.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:18.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:18.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO state.py:2068 (2): Update complete (62 -> 63) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:18.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO state.py:1684 (84): Start update from 62 to 63 (discovery-trial034). 2026-02-18T03:28:18.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:18] INFO state.py:2068 (84): Update complete (62 -> 63) (discovery-trial034). 2026-02-18T03:28:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-mon[24719]: pgmap v155: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/311608215' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3732962016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-mon[21825]: pgmap v155: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/311608215' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3732962016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.332 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-mon[24100]: pgmap v155: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:19.332 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/311608215' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.332 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:18 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/3732962016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:19.336 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode15 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:19.359 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:19.359 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:28:19.359 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.155 and name trial155' 2026-02-18T03:28:19.360 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.155 and name trial155 2026-02-18T03:28:19.360 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode16 --host-name trial155 --traddr 10.20.193.155 --trsvcid 4420 2026-02-18T03:28:19.403 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:19.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode15_trial155_TCP_10.20.193.155_4420, OMAP version: 64 2026-02-18T03:28:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:19.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO state.py:1684 (141): Start update from 63 to 64 (discovery-trial086). 2026-02-18T03:28:20.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:19] INFO state.py:2068 (141): Update complete (63 -> 64) (discovery-trial086). 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO state.py:1684 (129): Start update from 63 to 64 (discovery-trial177). 2026-02-18T03:28:20.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:19] INFO state.py:2068 (129): Update complete (63 -> 64) (discovery-trial177). 2026-02-18T03:28:20.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:36474 2026-02-18T03:28:20.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:20.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] INFO state.py:1684 (108): Start update from 63 to 64 (discovery-trial155). 2026-02-18T03:28:20.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:19] INFO state.py:2068 (108): Update complete (63 -> 64) (discovery-trial155). 2026-02-18T03:28:20.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO state.py:1684 (2): Start update from 63 to 64 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:20.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:20.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:20.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO state.py:2068 (2): Update complete (63 -> 64) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:20.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO state.py:1684 (84): Start update from 63 to 64 (discovery-trial034). 2026-02-18T03:28:20.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:19] INFO state.py:2068 (84): Update complete (63 -> 64) (discovery-trial034). 2026-02-18T03:28:20.880 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode16 listener at 10.20.193.155:4420: Successful 2026-02-18T03:28:20.903 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:28:20.903 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.177 2026-02-18T03:28:20.903 INFO:tasks.workunit.client.0.trial014.stderr:+ name=trial177 2026-02-18T03:28:20.903 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:28:20.904 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:20.904 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:28:20.904 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:20.904 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:20.904 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:20.946 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:20] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-mon[24719]: pgmap v156: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/22395071' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:20] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:20] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode16_trial155_TCP_10.20.193.155_4420, OMAP version: 65 2026-02-18T03:28:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:20] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:20 trial034 ceph-mon[21825]: pgmap v156: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/22395071' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:21.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:20] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:20 trial086 ceph-mon[24100]: pgmap v156: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 128 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2026-02-18T03:28:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:20 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/22395071' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:21.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:20] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:43272 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO state.py:1684 (129): Start update from 64 to 65 (discovery-trial177). 2026-02-18T03:28:21.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:21] INFO state.py:2068 (129): Update complete (64 -> 65) (discovery-trial177). 2026-02-18T03:28:21.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:21] INFO state.py:1684 (108): Start update from 64 to 65 (discovery-trial155). 2026-02-18T03:28:21.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:21] INFO state.py:2068 (108): Update complete (64 -> 65) (discovery-trial155). 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO state.py:1684 (84): Start update from 64 to 65 (discovery-trial034). 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO state.py:2068 (84): Update complete (64 -> 65) (discovery-trial034). 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:28:21.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:21] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO state.py:1684 (2): Start update from 64 to 65 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:28:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO state.py:2068 (2): Update complete (64 -> 65) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO state.py:1684 (141): Start update from 64 to 65 (discovery-trial086). 2026-02-18T03:28:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:21] INFO state.py:2068 (141): Update complete (64 -> 65) (discovery-trial086). 2026-02-18T03:28:22.407 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:22.428 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:22.428 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:28:22.429 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:22.429 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:22.429 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:22.456 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:22Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:22.386796] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.177 port 4420 *** 2026-02-18T03:28:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode1_trial177_TCP_10.20.193.177_4420, OMAP version: 66 2026-02-18T03:28:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:22.946 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:22.966 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:22.966 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:28:22.966 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:22.966 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:22.967 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:23.004 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:23.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:1684 (129): Start update from 65 to 66 (discovery-trial177). 2026-02-18T03:28:23.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:2068 (129): Update complete (65 -> 66) (discovery-trial177). 2026-02-18T03:28:23.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:46100 2026-02-18T03:28:23.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:23.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode2_trial177_TCP_10.20.193.177_4420, OMAP version: 67 2026-02-18T03:28:23.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:22] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-mon[24719]: pgmap v157: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 180 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:28:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1395355901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO state.py:1684 (108): Start update from 65 to 66 (discovery-trial155). 2026-02-18T03:28:23.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO state.py:2068 (108): Update complete (65 -> 66) (discovery-trial155). 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-mon[21825]: pgmap v157: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 180 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:28:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1395355901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO state.py:1684 (84): Start update from 65 to 66 (discovery-trial034). 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] INFO state.py:2068 (84): Update complete (65 -> 66) (discovery-trial034). 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:22] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-mon[24100]: pgmap v157: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 180 KiB/s rd, 2.3 KiB/s wr, 69 op/s 2026-02-18T03:28:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/1395355901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO state.py:1684 (2): Start update from 65 to 66 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO state.py:2068 (2): Update complete (65 -> 66) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO state.py:1684 (141): Start update from 65 to 66 (discovery-trial086). 2026-02-18T03:28:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] INFO state.py:2068 (141): Update complete (65 -> 66) (discovery-trial086). 2026-02-18T03:28:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:22] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.454 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:23.701 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:23.701 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:28:23.702 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:23.702 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:23.702 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode4 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:23.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:48604 2026-02-18T03:28:23.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode3_trial177_TCP_10.20.193.177_4420, OMAP version: 68 2026-02-18T03:28:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.775 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:23.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:23.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.038 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode4 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:24.059 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:24.059 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:28:24.059 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:24.060 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:24.060 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode5 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:24.094 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] INFO state.py:1684 (129): Start update from 66 to 68 (discovery-trial177). 2026-02-18T03:28:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:23] INFO state.py:2068 (129): Update complete (66 -> 68) (discovery-trial177). 2026-02-18T03:28:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:58170 2026-02-18T03:28:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode4_trial177_TCP_10.20.193.177_4420, OMAP version: 69 2026-02-18T03:28:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO state.py:1684 (108): Start update from 66 to 68 (discovery-trial155). 2026-02-18T03:28:24.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO state.py:2068 (108): Update complete (66 -> 68) (discovery-trial155). 2026-02-18T03:28:24.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO state.py:1684 (2): Start update from 66 to 68 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:24.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:24.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:24.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:23] INFO state.py:2068 (2): Update complete (66 -> 68) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:24.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:28:24.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:28:24.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: states { 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: grp_id: 4 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: state: INACCESSIBLE 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: } 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: ], , client address: IPv4 10.20.193.34:48832 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] INFO state.py:1684 (2): Start update from 66 to 68 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:24.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] INFO state.py:1684 (84): Start update from 66 to 68 (discovery-trial034). 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:23] INFO state.py:2068 (84): Update complete (66 -> 68) (discovery-trial034). 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO state.py:2068 (2): Update complete (66 -> 68) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO state.py:1684 (2): Start update from 66 to 68 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:24.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO state.py:2068 (2): Update complete (66 -> 68) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:24.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO state.py:1684 (141): Start update from 66 to 68 (discovery-trial086). 2026-02-18T03:28:24.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:23] INFO state.py:2068 (141): Update complete (66 -> 68) (discovery-trial086). 2026-02-18T03:28:24.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO state.py:1684 (141): Start update from 68 to 69 (discovery-trial086). 2026-02-18T03:28:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO state.py:2068 (141): Update complete (68 -> 69) (discovery-trial086). 2026-02-18T03:28:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:24] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:24.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:24.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO state.py:1684 (84): Start update from 68 to 69 (discovery-trial034). 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:24] INFO state.py:2068 (84): Update complete (68 -> 69) (discovery-trial034). 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO state.py:1684 (108): Start update from 68 to 69 (discovery-trial155). 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO state.py:2068 (108): Update complete (68 -> 69) (discovery-trial155). 2026-02-18T03:28:24.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO state.py:1684 (2): Start update from 68 to 69 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:24.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:24.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:24.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:24] INFO state.py:2068 (2): Update complete (68 -> 69) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:24.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:48874 2026-02-18T03:28:24.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:24.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO state.py:1684 (129): Start update from 68 to 69 (discovery-trial177). 2026-02-18T03:28:24.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:24] INFO state.py:2068 (129): Update complete (68 -> 69) (discovery-trial177). 2026-02-18T03:28:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:24 trial155 ceph-mon[24719]: pgmap v158: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 112 KiB/s rd, 1.3 KiB/s wr, 41 op/s 2026-02-18T03:28:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:24 trial034 ceph-mon[21825]: pgmap v158: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 112 KiB/s rd, 1.3 KiB/s wr, 41 op/s 2026-02-18T03:28:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:24 trial086 ceph-mon[24100]: pgmap v158: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 112 KiB/s rd, 1.3 KiB/s wr, 41 op/s 2026-02-18T03:28:25.571 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode5 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:25.593 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:25.593 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:28:25.593 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:25.594 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:25.594 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode6 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:25.633 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:25.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:25] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:25] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:25] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:25.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:25] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode5_trial177_TCP_10.20.193.177_4420, OMAP version: 70 2026-02-18T03:28:25.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:25.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:25] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.123 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode6 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:26.142 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:26.142 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:28:26.143 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:26.143 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:26.143 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode7 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:26.189 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:26.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:25 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/309495408' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO state.py:1684 (108): Start update from 69 to 70 (discovery-trial155). 2026-02-18T03:28:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO state.py:2068 (108): Update complete (69 -> 70) (discovery-trial155). 2026-02-18T03:28:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/309495408' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:26.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO state.py:1684 (84): Start update from 69 to 70 (discovery-trial034). 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] INFO state.py:2068 (84): Update complete (69 -> 70) (discovery-trial034). 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:25 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/309495408' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO state.py:1684 (2): Start update from 69 to 70 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO state.py:1684 (141): Start update from 69 to 70 (discovery-trial086). 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO state.py:2068 (2): Update complete (69 -> 70) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] INFO state.py:2068 (141): Update complete (69 -> 70) (discovery-trial086). 2026-02-18T03:28:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO state.py:1684 (129): Start update from 69 to 70 (discovery-trial177). 2026-02-18T03:28:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO state.py:2068 (129): Update complete (69 -> 70) (discovery-trial177). 2026-02-18T03:28:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51452 2026-02-18T03:28:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:26.409 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode6_trial177_TCP_10.20.193.177_4420, OMAP version: 71 2026-02-18T03:28:26.410 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.410 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.635 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode7 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:26.655 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:26.655 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:28:26.655 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:26.656 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:26.656 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode8 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:26.701 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:56584 2026-02-18T03:28:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode7_trial177_TCP_10.20.193.177_4420, OMAP version: 72 2026-02-18T03:28:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.910 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.911 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.911 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:26.911 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.162 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:26] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:28:27.162 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.162 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.162 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.162 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:28:27.163 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.164 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:28:27.165 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 4 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: ], , client address: IPv4 10.20.193.177:40666 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:1684 (129): Start update from 70 to 72 (discovery-trial177). 2026-02-18T03:28:27.169 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:2068 (129): Update complete (70 -> 72) (discovery-trial177). 2026-02-18T03:28:27.170 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:58742 2026-02-18T03:28:27.170 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:27.191 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:26 trial086 ceph-mon[24100]: pgmap v159: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 181 KiB/s rd, 2.2 KiB/s wr, 64 op/s 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 70 to 72 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (70 -> 72) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:27.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:1684 (141): Start update from 70 to 72 (discovery-trial086). 2026-02-18T03:28:27.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:2068 (141): Update complete (70 -> 72) (discovery-trial086). 2026-02-18T03:28:27.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.193 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:26 trial034 ceph-mon[21825]: pgmap v159: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 181 KiB/s rd, 2.2 KiB/s wr, 64 op/s 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 70 to 72 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:27.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (70 -> 72) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:27.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:1684 (84): Start update from 70 to 72 (discovery-trial034). 2026-02-18T03:28:27.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:2068 (84): Update complete (70 -> 72) (discovery-trial034). 2026-02-18T03:28:27.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.194 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:26 trial155 ceph-mon[24719]: pgmap v159: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 181 KiB/s rd, 2.2 KiB/s wr, 64 op/s 2026-02-18T03:28:27.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:1684 (108): Start update from 70 to 72 (discovery-trial155). 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:2068 (108): Update complete (70 -> 72) (discovery-trial155). 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 70 to 72 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (70 -> 72) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:27.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.196 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode8 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:27.214 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:27.215 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:28:27.215 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:27.215 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:27.215 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode9 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:27.258 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:27.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode8_trial177_TCP_10.20.193.177_4420, OMAP version: 73 2026-02-18T03:28:27.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.735 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode9 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:27.761 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:27.761 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:28:27.762 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:27.762 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:27.762 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode10 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:27.803 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:53376 2026-02-18T03:28:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:1684 (129): Start update from 72 to 73 (discovery-trial177). 2026-02-18T03:28:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:2068 (129): Update complete (72 -> 73) (discovery-trial177). 2026-02-18T03:28:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:27.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode9_trial177_TCP_10.20.193.177_4420, OMAP version: 74 2026-02-18T03:28:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:27] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/4056721962' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:27.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:1684 (108): Start update from 72 to 73 (discovery-trial155). 2026-02-18T03:28:27.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:2068 (108): Update complete (72 -> 73) (discovery-trial155). 2026-02-18T03:28:27.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4056721962' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:1684 (84): Start update from 72 to 73 (discovery-trial034). 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] INFO state.py:2068 (84): Update complete (72 -> 73) (discovery-trial034). 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:27] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/4056721962' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:28.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:1684 (2): Start update from 72 to 73 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:28.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:28.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:28.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:2068 (2): Update complete (72 -> 73) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:28.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:1684 (141): Start update from 72 to 73 (discovery-trial086). 2026-02-18T03:28:28.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] INFO state.py:2068 (141): Update complete (72 -> 73) (discovery-trial086). 2026-02-18T03:28:28.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:27] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.252 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode10 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:28.279 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:28.279 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:28:28.279 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:28.280 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:28.280 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode11 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:28.321 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:28.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:28] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:28] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:43748 2026-02-18T03:28:28.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode10_trial177_TCP_10.20.193.177_4420, OMAP version: 75 2026-02-18T03:28:28.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:28] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:28.755 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode11 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:28.776 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:28.776 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:28:28.776 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:28.777 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:28.777 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode12 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:28.820 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:29.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:28 trial034 ceph-mon[21825]: pgmap v160: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:29.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:28] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:28 trial086 ceph-mon[24100]: pgmap v160: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:29.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:28] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:28 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:59704 2026-02-18T03:28:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:28] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode11_trial177_TCP_10.20.193.177_4420, OMAP version: 76 2026-02-18T03:28:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:28 trial155 ceph-mon[24719]: pgmap v160: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:29.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:28] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:28] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.324 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode12 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:29.344 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:29.345 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:28:29.345 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:29.345 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:29.346 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode13 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:29.392 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 73 to 76 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (73 -> 76) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:29.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:1684 (84): Start update from 73 to 76 (discovery-trial034). 2026-02-18T03:28:29.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:2068 (84): Update complete (73 -> 76) (discovery-trial034). 2026-02-18T03:28:29.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:1684 (141): Start update from 73 to 76 (discovery-trial086). 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:2068 (141): Update complete (73 -> 76) (discovery-trial086). 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 73 to 76 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (73 -> 76) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:1684 (129): Start update from 73 to 76 (discovery-trial177). 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:2068 (129): Update complete (73 -> 76) (discovery-trial177). 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:52232 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode12_trial177_TCP_10.20.193.177_4420, OMAP version: 77 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:1684 (108): Start update from 73 to 76 (discovery-trial155). 2026-02-18T03:28:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:2068 (108): Update complete (73 -> 76) (discovery-trial155). 2026-02-18T03:28:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 73 to 76 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:29.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (73 -> 76) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:29.872 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode13 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:29.891 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:29.891 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:28:29.891 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:29.892 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:29.892 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode14 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:29.938 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:30.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/671106561' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:1684 (141): Start update from 76 to 77 (discovery-trial086). 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:2068 (141): Update complete (76 -> 77) (discovery-trial086). 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:1684 (129): Start update from 76 to 77 (discovery-trial177). 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:2068 (129): Update complete (76 -> 77) (discovery-trial177). 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:44054 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode13_trial177_TCP_10.20.193.177_4420, OMAP version: 78 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:29 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:29] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/671106561' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:1684 (108): Start update from 76 to 77 (discovery-trial155). 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:2068 (108): Update complete (76 -> 77) (discovery-trial155). 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/671106561' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:1684 (2): Start update from 76 to 77 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:2068 (2): Update complete (76 -> 77) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:1684 (84): Start update from 76 to 77 (discovery-trial034). 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] INFO state.py:2068 (84): Update complete (76 -> 77) (discovery-trial034). 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:29] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.416 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode14 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:30.435 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:30.435 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:28:30.436 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:30.436 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:30.436 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode15 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:30.483 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:30.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:1684 (129): Start update from 77 to 78 (discovery-trial177). 2026-02-18T03:28:30.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:2068 (129): Update complete (77 -> 78) (discovery-trial177). 2026-02-18T03:28:30.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:51662 2026-02-18T03:28:30.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:30.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode14_trial177_TCP_10.20.193.177_4420, OMAP version: 79 2026-02-18T03:28:30.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:1684 (108): Start update from 77 to 78 (discovery-trial155). 2026-02-18T03:28:30.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:2068 (108): Update complete (77 -> 78) (discovery-trial155). 2026-02-18T03:28:30.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:30.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:30.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:30.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:1684 (84): Start update from 77 to 78 (discovery-trial034). 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:2068 (84): Update complete (77 -> 78) (discovery-trial034). 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:1684 (141): Start update from 77 to 78 (discovery-trial086). 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:2068 (141): Update complete (77 -> 78) (discovery-trial086). 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 77 to 78 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:30.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (77 -> 78) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:30.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:30.960 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode15 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:30.980 INFO:tasks.workunit.client.0.trial014.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:30.980 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:28:30.980 INFO:tasks.workunit.client.0.trial014.stdout:Adding gateway listener with IP 10.20.193.177 and name trial177 2026-02-18T03:28:30.981 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Adding gateway listener with IP 10.20.193.177 and name trial177' 2026-02-18T03:28:30.981 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode16 --host-name trial177 --traddr 10.20.193.177 --trsvcid 4420 2026-02-18T03:28:31.031 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:31.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:1684 (129): Start update from 78 to 79 (discovery-trial177). 2026-02-18T03:28:31.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:2068 (129): Update complete (78 -> 79) (discovery-trial177). 2026-02-18T03:28:31.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:39790 2026-02-18T03:28:31.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:31.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode15_trial177_TCP_10.20.193.177_4420, OMAP version: 80 2026-02-18T03:28:31.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:30 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:30] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-mon[24719]: pgmap v161: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:31.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:1684 (108): Start update from 78 to 79 (discovery-trial155). 2026-02-18T03:28:31.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:2068 (108): Update complete (78 -> 79) (discovery-trial155). 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-mon[21825]: pgmap v161: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:1684 (84): Start update from 78 to 79 (discovery-trial034). 2026-02-18T03:28:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:2068 (84): Update complete (78 -> 79) (discovery-trial034). 2026-02-18T03:28:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:31.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:31.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:31.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:30] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-mon[24100]: pgmap v161: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 1.5 KiB/s wr, 41 op/s 2026-02-18T03:28:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:1684 (141): Start update from 78 to 79 (discovery-trial086). 2026-02-18T03:28:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:2068 (141): Update complete (78 -> 79) (discovery-trial086). 2026-02-18T03:28:31.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:1684 (2): Start update from 78 to 79 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] INFO state.py:2068 (2): Update complete (78 -> 79) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:30] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:31.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:31] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: False, context: , client address: IPv4 10.20.193.14:53640 2026-02-18T03:28:31.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:31] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:31.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:31] INFO state.py:1684 (129): Start update from 79 to 80 (discovery-trial177). 2026-02-18T03:28:31.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:31] INFO state.py:2068 (129): Update complete (79 -> 80) (discovery-trial177). 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO state.py:1684 (108): Start update from 79 to 80 (discovery-trial155). 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO state.py:2068 (108): Update complete (79 -> 80) (discovery-trial155). 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO state.py:1684 (2): Start update from 79 to 80 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:31.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:31] INFO state.py:2068 (2): Update complete (79 -> 80) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO state.py:1684 (2): Start update from 79 to 80 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO state.py:2068 (2): Update complete (79 -> 80) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO state.py:1684 (84): Start update from 79 to 80 (discovery-trial034). 2026-02-18T03:28:31.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:31] INFO state.py:2068 (84): Update complete (79 -> 80) (discovery-trial034). 2026-02-18T03:28:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO state.py:1684 (141): Start update from 79 to 80 (discovery-trial086). 2026-02-18T03:28:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO state.py:2068 (141): Update complete (79 -> 80) (discovery-trial086). 2026-02-18T03:28:31.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO state.py:1684 (2): Start update from 79 to 80 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:31.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:31.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:31.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:31] INFO state.py:2068 (2): Update complete (79 -> 80) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:32.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1454813645' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:32.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1454813645' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:32.333 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1454813645' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:32.492 INFO:tasks.workunit.client.0.trial014.stdout:Adding nqn.2016-06.io.spdk:cnode16 listener at 10.20.193.177:4420: Successful 2026-02-18T03:28:32.520 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:28:32.521 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:32.521 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:28:32.521 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode1 --host '*' 2026-02-18T03:28:32.559 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:32.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:32.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] INFO state.py:1053 (2): omap_key generated: listener_nqn.2016-06.io.spdk:cnode16_trial177_TCP_10.20.193.177_4420, OMAP version: 81 2026-02-18T03:28:32.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:32.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.027 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:28:33.027 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode1 might be a security breach 2026-02-18T03:28:33.046 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:33.046 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:28:33.046 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode2 --host '*' 2026-02-18T03:28:33.080 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-mon[24719]: pgmap v162: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 224 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/579910727' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO state.py:1684 (108): Start update from 80 to 81 (discovery-trial155). 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO state.py:2068 (108): Update complete (80 -> 81) (discovery-trial155). 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO state.py:1684 (2): Start update from 80 to 81 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:32] INFO state.py:2068 (2): Update complete (80 -> 81) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-mon[21825]: pgmap v162: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 224 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/579910727' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO state.py:1684 (2): Start update from 80 to 81 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO state.py:2068 (2): Update complete (80 -> 81) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO state.py:1684 (84): Start update from 80 to 81 (discovery-trial034). 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:32] INFO state.py:2068 (84): Update complete (80 -> 81) (discovery-trial034). 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: , client address: IPv4 10.20.193.14:33654 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:33.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:33.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode1_*, OMAP version: 82 2026-02-18T03:28:33.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-mon[24100]: pgmap v162: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 224 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2026-02-18T03:28:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/579910727' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO state.py:1684 (141): Start update from 80 to 81 (discovery-trial086). 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO state.py:2068 (141): Update complete (80 -> 81) (discovery-trial086). 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO state.py:1684 (2): Start update from 80 to 81 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:32 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:32] INFO state.py:2068 (2): Update complete (80 -> 81) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] INFO state.py:1684 (129): Start update from 80 to 81 (discovery-trial177). 2026-02-18T03:28:33.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:32 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:32] INFO state.py:2068 (129): Update complete (80 -> 81) (discovery-trial177). 2026-02-18T03:28:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.554 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:28:33.554 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode2 might be a security breach 2026-02-18T03:28:33.574 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:33.575 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:28:33.575 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode3 --host '*' 2026-02-18T03:28:33.613 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] INFO state.py:1684 (2): Start update from 81 to 82 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] INFO state.py:1684 (141): Start update from 81 to 82 (discovery-trial086). 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] INFO state.py:2068 (141): Update complete (81 -> 82) (discovery-trial086). 2026-02-18T03:28:33.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] INFO state.py:2068 (2): Update complete (81 -> 82) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:33.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:33 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] INFO state.py:1684 (2): Start update from 81 to 82 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:28:33.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] INFO state.py:1684 (129): Start update from 81 to 82 (discovery-trial177). 2026-02-18T03:28:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] INFO state.py:2068 (129): Update complete (81 -> 82) (discovery-trial177). 2026-02-18T03:28:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] INFO state.py:2068 (2): Update complete (81 -> 82) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:33 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:33] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] INFO state.py:1684 (108): Start update from 81 to 82 (discovery-trial155). 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] INFO state.py:2068 (108): Update complete (81 -> 82) (discovery-trial155). 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] INFO state.py:1684 (2): Start update from 81 to 82 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:33.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] INFO state.py:2068 (2): Update complete (81 -> 82) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:33.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:33.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:1684 (84): Start update from 81 to 82 (discovery-trial034). 2026-02-18T03:28:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:2068 (84): Update complete (81 -> 82) (discovery-trial034). 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: , client address: IPv4 10.20.193.14:60648 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode2_*, OMAP version: 83 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:33] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.090 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:28:34.090 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode3 might be a security breach 2026-02-18T03:28:34.110 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:34.110 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:28:34.110 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode4 --host '*' 2026-02-18T03:28:34.156 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:34Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:1684 (141): Start update from 82 to 83 (discovery-trial086). 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:2068 (141): Update complete (82 -> 83) (discovery-trial086). 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 82 to 83 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (82 -> 83) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 82 to 83 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:28:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:1684 (129): Start update from 82 to 83 (discovery-trial177). 2026-02-18T03:28:34.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:2068 (129): Update complete (82 -> 83) (discovery-trial177). 2026-02-18T03:28:34.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (82 -> 83) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:34.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:1684 (108): Start update from 82 to 83 (discovery-trial155). 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:2068 (108): Update complete (82 -> 83) (discovery-trial155). 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 82 to 83 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (82 -> 83) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:34.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:1684 (84): Start update from 82 to 83 (discovery-trial034). 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:2068 (84): Update complete (82 -> 83) (discovery-trial034). 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: , client address: IPv4 10.20.193.14:54754 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode3_*, OMAP version: 84 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:1684 (141): Start update from 83 to 84 (discovery-trial086). 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:2068 (141): Update complete (83 -> 84) (discovery-trial086). 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 83 to 84 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (83 -> 84) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: , client address: IPv4 10.20.193.14:58536 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] WARNING state.py:640 (2): The OMAP file is locked, will try again in 1.0 seconds 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:1684 (84): Start update from 83 to 84 (discovery-trial034). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:34] INFO state.py:2068 (84): Update complete (83 -> 84) (discovery-trial034). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:1684 (108): Start update from 83 to 84 (discovery-trial155). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:2068 (108): Update complete (83 -> 84) (discovery-trial155). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 83 to 84 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (83 -> 84) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:1684 (2): Start update from 83 to 84 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:1684 (129): Start update from 83 to 84 (discovery-trial177). 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:2068 (129): Update complete (83 -> 84) (discovery-trial177). 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:34] INFO state.py:2068 (2): Update complete (83 -> 84) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-mon[24719]: pgmap v163: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 172 KiB/s rd, 2.3 KiB/s wr, 57 op/s 2026-02-18T03:28:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:34 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/4066014714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-mon[21825]: pgmap v163: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 172 KiB/s rd, 2.3 KiB/s wr, 57 op/s 2026-02-18T03:28:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4066014714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:35.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-mon[24100]: pgmap v163: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 172 KiB/s rd, 2.3 KiB/s wr, 57 op/s 2026-02-18T03:28:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:34 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/4066014714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:35.610 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:28:35.610 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode4 might be a security breach 2026-02-18T03:28:35.631 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:35.631 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:28:35.631 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode5 --host '*' 2026-02-18T03:28:35.674 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:35] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:35.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:35.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:35 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:35] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:35.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:35] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:35.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:35] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:35] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode4_*, OMAP version: 85 2026-02-18T03:28:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:35] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:35] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.114 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:28:36.114 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode5 might be a security breach 2026-02-18T03:28:36.132 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:36.132 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:28:36.132 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode6 --host '*' 2026-02-18T03:28:36.170 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.461 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.461 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: , client address: IPv4 10.20.193.14:47960 2026-02-18T03:28:36.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:36.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode5_*, OMAP version: 86 2026-02-18T03:28:36.606 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:28:36.606 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode6 might be a security breach 2026-02-18T03:28:36.629 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:36.629 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:28:36.629 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode7 --host '*' 2026-02-18T03:28:36.669 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:36.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO state.py:1684 (2): Start update from 84 to 87 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO state.py:1684 (129): Start update from 84 to 87 (discovery-trial177). 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO state.py:2068 (129): Update complete (84 -> 87) (discovery-trial177). 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:28:36.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:36 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:36] INFO state.py:2068 (2): Update complete (84 -> 87) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:36.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO state.py:1684 (2): Start update from 84 to 87 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:36.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:28:36.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO state.py:1684 (141): Start update from 84 to 87 (discovery-trial086). 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO state.py:2068 (141): Update complete (84 -> 87) (discovery-trial086). 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:36] INFO state.py:2068 (2): Update complete (84 -> 87) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: , client address: IPv4 10.20.193.14:49074 2026-02-18T03:28:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode6_*, OMAP version: 87 2026-02-18T03:28:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO state.py:1684 (84): Start update from 84 to 87 (discovery-trial034). 2026-02-18T03:28:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:36] INFO state.py:2068 (84): Update complete (84 -> 87) (discovery-trial034). 2026-02-18T03:28:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO state.py:1684 (108): Start update from 84 to 87 (discovery-trial155). 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO state.py:2068 (108): Update complete (84 -> 87) (discovery-trial155). 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO state.py:1684 (2): Start update from 84 to 87 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:36] INFO state.py:2068 (2): Update complete (84 -> 87) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:37.132 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:28:37.132 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode7 might be a security breach 2026-02-18T03:28:37.154 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:37.154 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:28:37.155 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode8 --host '*' 2026-02-18T03:28:37.193 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-mon[24719]: pgmap v164: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 285 KiB/s rd, 3.3 KiB/s wr, 89 op/s 2026-02-18T03:28:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/273700837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-mon[21825]: pgmap v164: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 285 KiB/s rd, 3.3 KiB/s wr, 89 op/s 2026-02-18T03:28:37.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/273700837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: , client address: IPv4 10.20.193.14:56168 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode7_*, OMAP version: 88 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-mon[24100]: pgmap v164: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 285 KiB/s rd, 3.3 KiB/s wr, 89 op/s 2026-02-18T03:28:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/273700837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:37.618 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:28:37.618 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode8 might be a security breach 2026-02-18T03:28:37.637 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:37.637 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:28:37.637 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode9 --host '*' 2026-02-18T03:28:37.681 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:37Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO state.py:1684 (2): Start update from 87 to 89 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:28:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:28:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO state.py:1684 (129): Start update from 87 to 89 (discovery-trial177). 2026-02-18T03:28:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO state.py:2068 (129): Update complete (87 -> 89) (discovery-trial177). 2026-02-18T03:28:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:37 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:37] INFO state.py:2068 (2): Update complete (87 -> 89) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO state.py:1684 (108): Start update from 87 to 89 (discovery-trial155). 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO state.py:2068 (108): Update complete (87 -> 89) (discovery-trial155). 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO state.py:1684 (2): Start update from 87 to 89 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:28:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:37] INFO state.py:2068 (2): Update complete (87 -> 89) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:38.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: , client address: IPv4 10.20.193.14:46950 2026-02-18T03:28:38.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode8_*, OMAP version: 89 2026-02-18T03:28:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO state.py:1684 (84): Start update from 87 to 89 (discovery-trial034). 2026-02-18T03:28:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:37] INFO state.py:2068 (84): Update complete (87 -> 89) (discovery-trial034). 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO state.py:1684 (141): Start update from 87 to 89 (discovery-trial086). 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO state.py:2068 (141): Update complete (87 -> 89) (discovery-trial086). 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO state.py:1684 (2): Start update from 87 to 89 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:28:38.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:37 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:37] INFO state.py:2068 (2): Update complete (87 -> 89) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:38.135 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:28:38.135 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode9 might be a security breach 2026-02-18T03:28:38.155 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:38.155 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:28:38.155 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode10 --host '*' 2026-02-18T03:28:38.197 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:38.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: , client address: IPv4 10.20.193.14:33062 2026-02-18T03:28:38.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:38.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode9_*, OMAP version: 90 2026-02-18T03:28:38.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.659 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:28:38.659 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode10 might be a security breach 2026-02-18T03:28:38.678 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:38.678 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:28:38.678 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode11 --host '*' 2026-02-18T03:28:38.729 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: , client address: IPv4 10.20.193.14:56000 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:1684 (84): Start update from 89 to 90 (discovery-trial034). 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:2068 (84): Update complete (89 -> 90) (discovery-trial034). 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode10_*, OMAP version: 91 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:38] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] INFO state.py:1684 (108): Start update from 89 to 90 (discovery-trial155). 2026-02-18T03:28:38.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] INFO state.py:2068 (108): Update complete (89 -> 90) (discovery-trial155). 2026-02-18T03:28:38.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] INFO state.py:1684 (2): Start update from 89 to 90 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] INFO state.py:2068 (2): Update complete (89 -> 90) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.929 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] INFO state.py:1684 (2): Start update from 89 to 90 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] INFO state.py:1684 (141): Start update from 89 to 90 (discovery-trial086). 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] INFO state.py:2068 (141): Update complete (89 -> 90) (discovery-trial086). 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] INFO state.py:2068 (2): Update complete (89 -> 90) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.930 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] INFO state.py:1684 (2): Start update from 89 to 90 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] INFO state.py:1684 (129): Start update from 89 to 90 (discovery-trial177). 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] INFO state.py:2068 (129): Update complete (89 -> 90) (discovery-trial177). 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] INFO state.py:2068 (2): Update complete (89 -> 90) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:38] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.154 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:28:39.154 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode11 might be a security breach 2026-02-18T03:28:39.173 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:39.173 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:28:39.173 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode12 --host '*' 2026-02-18T03:28:39.177 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:38 trial155 ceph-mon[24719]: pgmap v165: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO state.py:1684 (108): Start update from 90 to 92 (discovery-trial155). 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO state.py:1684 (2): Start update from 90 to 92 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO state.py:2068 (108): Update complete (90 -> 92) (discovery-trial155). 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:28:39.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.182 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:38 trial086 ceph-mon[24100]: pgmap v165: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:39.182 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO state.py:1684 (141): Start update from 90 to 92 (discovery-trial086). 2026-02-18T03:28:39.182 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO state.py:2068 (141): Update complete (90 -> 92) (discovery-trial086). 2026-02-18T03:28:39.182 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO state.py:1684 (2): Start update from 90 to 92 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:39.182 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:28:39.183 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.183 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:28:39.183 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.183 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] INFO state.py:2068 (2): Update complete (90 -> 92) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:39.223 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:38 trial034 ceph-mon[21825]: pgmap v165: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: , client address: IPv4 10.20.193.14:42412 2026-02-18T03:28:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode11_*, OMAP version: 92 2026-02-18T03:28:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO state.py:1684 (84): Start update from 90 to 92 (discovery-trial034). 2026-02-18T03:28:39.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO state.py:2068 (84): Update complete (90 -> 92) (discovery-trial034). 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO state.py:1684 (2): Start update from 90 to 92 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO state.py:1684 (129): Start update from 90 to 92 (discovery-trial177). 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO state.py:2068 (129): Update complete (90 -> 92) (discovery-trial177). 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] INFO state.py:2068 (2): Update complete (90 -> 92) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:39.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] INFO state.py:2068 (2): Update complete (90 -> 92) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:39.695 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:28:39.695 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode12 might be a security breach 2026-02-18T03:28:39.715 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:39.715 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:28:39.715 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode13 --host '*' 2026-02-18T03:28:39.753 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:39.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: , client address: IPv4 10.20.193.14:57740 2026-02-18T03:28:39.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:39.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:39.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode12_*, OMAP version: 93 2026-02-18T03:28:39.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:39] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:39] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2053463937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:39.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1672055300' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:39.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:39.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/2053463937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1672055300' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:39] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.186 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2053463937' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.186 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1672055300' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:40.199 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:28:40.199 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode13 might be a security breach 2026-02-18T03:28:40.219 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:40.219 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:28:40.219 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode14 --host '*' 2026-02-18T03:28:40.265 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: , client address: IPv4 10.20.193.14:33550 2026-02-18T03:28:40.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode13_*, OMAP version: 94 2026-02-18T03:28:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:40.682 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:28:40.682 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode14 might be a security breach 2026-02-18T03:28:40.703 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:40.703 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:28:40.703 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode15 --host '*' 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO state.py:1684 (108): Start update from 92 to 95 (discovery-trial155). 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO state.py:2068 (108): Update complete (92 -> 95) (discovery-trial155). 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO state.py:1684 (2): Start update from 92 to 95 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:40] INFO state.py:2068 (2): Update complete (92 -> 95) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:40.736 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:40.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: , client address: IPv4 10.20.193.14:50864 2026-02-18T03:28:40.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode14_*, OMAP version: 95 2026-02-18T03:28:40.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO state.py:1684 (84): Start update from 92 to 95 (discovery-trial034). 2026-02-18T03:28:40.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:40] INFO state.py:2068 (84): Update complete (92 -> 95) (discovery-trial034). 2026-02-18T03:28:40.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO state.py:1684 (2): Start update from 92 to 95 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:40.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:28:40.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO state.py:1684 (129): Start update from 92 to 95 (discovery-trial177). 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO state.py:2068 (129): Update complete (92 -> 95) (discovery-trial177). 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:40.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:40 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:40] INFO state.py:2068 (2): Update complete (92 -> 95) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:41.122 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-mon[24100]: pgmap v166: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO state.py:1684 (141): Start update from 92 to 95 (discovery-trial086). 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO state.py:2068 (141): Update complete (92 -> 95) (discovery-trial086). 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO state.py:1684 (2): Start update from 92 to 95 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:41.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:40 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:40] INFO state.py:2068 (2): Update complete (92 -> 95) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:41.176 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:40 trial155 ceph-mon[24719]: pgmap v166: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:41.179 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:28:41.179 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode15 might be a security breach 2026-02-18T03:28:41.198 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:41.198 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:28:41.198 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode16 --host '*' 2026-02-18T03:28:41.240 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:40 trial034 ceph-mon[21825]: pgmap v166: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 216 KiB/s rd, 2.5 KiB/s wr, 65 op/s 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: , client address: IPv4 10.20.193.14:36004 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode15_*, OMAP version: 96 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:41] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:41] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:41] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.686 INFO:tasks.workunit.client.0.trial014.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:28:41.686 INFO:tasks.workunit.client.0.trial014.stdout:Open host access to subsystem nqn.2016-06.io.spdk:cnode16 might be a security breach 2026-02-18T03:28:41.704 INFO:tasks.workunit.client.0.trial014.stderr:+ image_index=1 2026-02-18T03:28:41.704 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 16 2026-02-18T03:28:41.705 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:41.705 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2026-02-18T03:28:41.705 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:41.706 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:41.706 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage1 2026-02-18T03:28:41.706 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage1 --load-balancing-group 2 2026-02-18T03:28:41.746 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:41] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:41] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:41.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: , client address: IPv4 10.20.193.14:59418 2026-02-18T03:28:42.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:41] INFO state.py:1053 (2): omap_key generated: host_nqn.2016-06.io.spdk:cnode16_*, OMAP version: 97 2026-02-18T03:28:42.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:41] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:41 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:41] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.443 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 95 to 97 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:1684 (129): Start update from 95 to 97 (discovery-trial177). 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:2068 (129): Update complete (95 -> 97) (discovery-trial177). 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (95 -> 97) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.464 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:42.464 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:42.464 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage2 2026-02-18T03:28:42.465 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage2 --load-balancing-group 3 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:1684 (108): Start update from 95 to 97 (discovery-trial155). 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:2068 (108): Update complete (95 -> 97) (discovery-trial155). 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 95 to 97 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (95 -> 97) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.510 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:42.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:1684 (84): Start update from 95 to 97 (discovery-trial034). 2026-02-18T03:28:42.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:2068 (84): Update complete (95 -> 97) (discovery-trial034). 2026-02-18T03:28:42.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:52662 2026-02-18T03:28:42.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage1, no need to remove 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:52662 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.318953] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.34:0/4070083421, rc 0 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.319151] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.34:0/4070083421 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.34:0/4070083421' 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.329367] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: , client address: IPv4 10.20.193.14:52662 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.334123] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.334370] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.334386] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_1, OMAP version: 98 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.439595] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:42.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:42.439622] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:1684 (141): Start update from 95 to 97 (discovery-trial086). 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:2068 (141): Update complete (95 -> 97) (discovery-trial086). 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 95 to 97 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (95 -> 97) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:42.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-mon[24100]: pgmap v167: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 338 KiB/s rd, 4.0 KiB/s wr, 99 op/s 2026-02-18T03:28:43.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/2496658699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:1684 (141): Start update from 97 to 98 (discovery-trial086). 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:2068 (141): Update complete (97 -> 98) (discovery-trial086). 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 97 to 98 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.898433] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.86:0/1621846221, rc 0 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.898658] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.86:0/1621846221 2026-02-18T03:28:43.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.86:0/1621846221' 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.908195] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.912835] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.913082] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:42.913097] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (97 -> 98) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.152 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-mon[21825]: pgmap v167: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 338 KiB/s rd, 4.0 KiB/s wr, 99 op/s 2026-02-18T03:28:43.152 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2496658699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:43.152 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:1684 (84): Start update from 97 to 98 (discovery-trial034). 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:2068 (84): Update complete (97 -> 98) (discovery-trial034). 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:39856 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage2, no need to remove 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:42] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:39856 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.031696] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.34:0/3738896478, rc 0 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.031758] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.34:0/3738896478 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.34:0/3738896478' 2026-02-18T03:28:43.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.042212] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: , client address: IPv4 10.20.193.14:39856 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.047276] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.047297] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_2, OMAP version: 99 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.151054] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:43.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.151084] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:43.155 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:28:43.175 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:43.176 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:43.176 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage3 2026-02-18T03:28:43.176 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage3 --load-balancing-group 4 2026-02-18T03:28:43.203 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:43.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 97 to 98 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:1684 (129): Start update from 97 to 98 (discovery-trial177). 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:2068 (129): Update complete (97 -> 98) (discovery-trial177). 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.893470] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.177:0/3732221522, rc 0 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.893652] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.177:0/3732221522 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.177:0/3732221522' 2026-02-18T03:28:43.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.903086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.907857] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.908199] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:42.908214] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:42 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (97 -> 98) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-mon[24719]: pgmap v167: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 338 KiB/s rd, 4.0 KiB/s wr, 99 op/s 2026-02-18T03:28:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2496658699' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:1684 (108): Start update from 97 to 98 (discovery-trial155). 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:2068 (108): Update complete (97 -> 98) (discovery-trial155). 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:1684 (2): Start update from 97 to 98 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.896847] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.155:0/2272477451, rc 0 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.897062] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.155:0/2272477451 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.155:0/2272477451' 2026-02-18T03:28:43.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.906079] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.910730] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.910934] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:42.910948] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:42] INFO state.py:2068 (2): Update complete (97 -> 98) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.841 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO state.py:1684 (84): Start update from 98 to 99 (discovery-trial034). 2026-02-18T03:28:43.841 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO state.py:2068 (84): Update complete (98 -> 99) (discovery-trial034). 2026-02-18T03:28:43.841 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:48526 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage3, no need to remove 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:48526 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.731234] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.34:0/3943143474, rc 0 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.731295] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.34:0/3943143474 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.34:0/3943143474' 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.741215] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: , client address: IPv4 10.20.193.14:48526 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.745627] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:28:43.842 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.745648] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_3, OMAP version: 100 2026-02-18T03:28:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:43] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.840298] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:43.840326] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:43.844 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:28:43.870 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:43.870 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:43.870 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage4 2026-02-18T03:28:43.870 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage4 --load-balancing-group 1 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO state.py:1684 (141): Start update from 98 to 99 (discovery-trial086). 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO state.py:2068 (141): Update complete (98 -> 99) (discovery-trial086). 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO state.py:1684 (2): Start update from 98 to 99 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:43.592630] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.86:0/1461339026, rc 0 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:43.592689] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.86:0/1461339026 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.86:0/1461339026' 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:43.603389] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:43.608163] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:43.608185] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] INFO state.py:2068 (2): Update complete (98 -> 99) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:43 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.913 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:43.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO state.py:1684 (2): Start update from 98 to 99 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO state.py:1684 (129): Start update from 98 to 99 (discovery-trial177). 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO state.py:2068 (129): Update complete (98 -> 99) (discovery-trial177). 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:43.592347] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.177:0/840651156, rc 0 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:43.593330] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.177:0/840651156 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.177:0/840651156' 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:43.604120] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:28:43.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:43.608972] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:28:43.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:43.608992] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:43.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] INFO state.py:2068 (2): Update complete (98 -> 99) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:43.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:43] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO state.py:1684 (108): Start update from 98 to 99 (discovery-trial155). 2026-02-18T03:28:43.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO state.py:2068 (108): Update complete (98 -> 99) (discovery-trial155). 2026-02-18T03:28:43.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO state.py:1684 (2): Start update from 98 to 99 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:43.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:43.594684] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.155:0/2601336626, rc 0 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:43.594750] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.155:0/2601336626 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.155:0/2601336626' 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:43.604794] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:43.609618] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:43.609643] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] INFO state.py:2068 (2): Update complete (98 -> 99) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:43.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:43] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:1684 (84): Start update from 99 to 100 (discovery-trial034). 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:2068 (84): Update complete (99 -> 100) (discovery-trial034). 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:60568 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage4, no need to remove 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:60568 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.421594] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.34:0/2115447323, rc 0 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.422094] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.34:0/2115447323 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.34:0/2115447323' 2026-02-18T03:28:44.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.431145] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: , client address: IPv4 10.20.193.14:60568 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.435775] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.435798] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode1_4, OMAP version: 101 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.531454] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:44.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:44.531484] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:44.535 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode1: Successful 2026-02-18T03:28:44.556 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:44.557 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:44.557 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2026-02-18T03:28:44.557 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:44.558 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:44.558 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage5 2026-02-18T03:28:44.558 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage5 --load-balancing-group 2 2026-02-18T03:28:44.591 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:44Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:1684 (141): Start update from 99 to 100 (discovery-trial086). 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:2068 (141): Update complete (99 -> 100) (discovery-trial086). 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 99 to 100 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.291927] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.86:0/3531592045, rc 0 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.291991] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.86:0/3531592045 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.86:0/3531592045' 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.302377] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.306814] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.306835] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:2068 (2): Update complete (99 -> 100) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 99 to 100 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:1684 (129): Start update from 99 to 100 (discovery-trial177). 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:2068 (129): Update complete (99 -> 100) (discovery-trial177). 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.289035] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.177:0/1492452812, rc 0 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.289090] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.177:0/1492452812 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.177:0/1492452812' 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.299023] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.303536] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.303556] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:2068 (2): Update complete (99 -> 100) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:1684 (108): Start update from 99 to 100 (discovery-trial155). 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:2068 (108): Update complete (99 -> 100) (discovery-trial155). 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 99 to 100 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.289794] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.155:0/3202054661, rc 0 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.289866] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.155:0/3202054661 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.155:0/3202054661' 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.299915] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.304478] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.304502] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:2068 (2): Update complete (99 -> 100) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:44.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:1684 (129): Start update from 100 to 101 (discovery-trial177). 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:2068 (129): Update complete (100 -> 101) (discovery-trial177). 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 100 to 101 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.979477] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.177:0/1955653291, rc 0 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.979527] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.177:0/1955653291 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.177:0/1955653291' 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.989151] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.993662] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:28:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:44 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:44.993681] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (100 -> 101) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-mon[21825]: pgmap v168: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 293 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:1684 (84): Start update from 100 to 101 (discovery-trial034). 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:44] INFO state.py:2068 (84): Update complete (100 -> 101) (discovery-trial034). 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:48630 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage5, no need to remove 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:48630 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.107695] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.34:0/2684916794, rc 0 2026-02-18T03:28:45.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.108066] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.34:0/2684916794 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.34:0/2684916794' 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.118074] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: , client address: IPv4 10.20.193.14:48630 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.122584] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.122608] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_1, OMAP version: 102 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.223837] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:45.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.223872] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:45.227 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:28:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-mon[24719]: pgmap v168: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 293 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2026-02-18T03:28:45.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:1684 (108): Start update from 100 to 101 (discovery-trial155). 2026-02-18T03:28:45.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:2068 (108): Update complete (100 -> 101) (discovery-trial155). 2026-02-18T03:28:45.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 100 to 101 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:45.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.980182] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.155:0/3865581962, rc 0 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.981031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.155:0/3865581962 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.155:0/3865581962' 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.990684] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.995243] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:44.995262] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (100 -> 101) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.254 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:45.254 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:45.254 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage6 2026-02-18T03:28:45.254 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage6 --load-balancing-group 3 2026-02-18T03:28:45.293 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-mon[24100]: pgmap v168: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 293 KiB/s rd, 2.7 KiB/s wr, 132 op/s 2026-02-18T03:28:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:1684 (2): Start update from 100 to 101 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:1684 (141): Start update from 100 to 101 (discovery-trial086). 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO state.py:2068 (141): Update complete (100 -> 101) (discovery-trial086). 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.978381] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.86:0/2592883755, rc 0 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.978441] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.86:0/2592883755 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.86:0/2592883755' 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.987584] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:44] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.992275] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:44.992297] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (100 -> 101) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:45.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:1684 (84): Start update from 101 to 102 (discovery-trial034). 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:2068 (84): Update complete (101 -> 102) (discovery-trial034). 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:36938 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage6, no need to remove 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:36938 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.811791] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.34:0/3131773710, rc 0 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.811857] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.34:0/3131773710 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.34:0/3131773710' 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.821836] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: , client address: IPv4 10.20.193.14:36938 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.826700] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.826724] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_2, OMAP version: 103 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:45] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.929473] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:45.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:45.929506] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:45.933 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO state.py:1684 (108): Start update from 101 to 102 (discovery-trial155). 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO state.py:2068 (108): Update complete (101 -> 102) (discovery-trial155). 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO state.py:1684 (2): Start update from 101 to 102 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:45.670750] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.155:0/3033015390, rc 0 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:45.670849] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.155:0/3033015390 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.155:0/3033015390' 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:45.681433] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:45.685898] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:45.685921] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (101 -> 102) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO state.py:1684 (141): Start update from 101 to 102 (discovery-trial086). 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO state.py:2068 (141): Update complete (101 -> 102) (discovery-trial086). 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO state.py:1684 (2): Start update from 101 to 102 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:45.671615] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.86:0/1985066125, rc 0 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:45.671675] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.86:0/1985066125 2026-02-18T03:28:45.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.86:0/1985066125' 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:45.682928] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:45.687488] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:45.687509] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (101 -> 102) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:45] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.956 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:45.956 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:45.956 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage7 2026-02-18T03:28:45.956 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage7 --load-balancing-group 4 2026-02-18T03:28:45.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO state.py:1684 (129): Start update from 101 to 102 (discovery-trial177). 2026-02-18T03:28:45.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO state.py:2068 (129): Update complete (101 -> 102) (discovery-trial177). 2026-02-18T03:28:45.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO state.py:1684 (2): Start update from 101 to 102 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:45.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:45.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:45.669666] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.177:0/2260922976, rc 0 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:45.669718] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.177:0/2260922976 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.177:0/2260922976' 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:45.680704] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:45.685259] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:45.685278] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] INFO state.py:2068 (2): Update complete (101 -> 102) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:45] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:45.989 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:46.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3161184749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3161184749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:46.347 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:45 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3161184749' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:46.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO state.py:1684 (2): Start update from 102 to 103 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:46.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:46.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:46.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO state.py:1684 (141): Start update from 102 to 103 (discovery-trial086). 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO state.py:2068 (141): Update complete (102 -> 103) (discovery-trial086). 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:46.371207] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.86:0/2361237557, rc 0 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:46.371283] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.86:0/2361237557 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.86:0/2361237557' 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:46.381098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:46.385829] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:46.385848] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] INFO state.py:2068 (2): Update complete (102 -> 103) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO state.py:1684 (84): Start update from 102 to 103 (discovery-trial034). 2026-02-18T03:28:46.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO state.py:2068 (84): Update complete (102 -> 103) (discovery-trial034). 2026-02-18T03:28:46.625 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:49708 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage7, no need to remove 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:49708 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.514665] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.34:0/2192402550, rc 0 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.514728] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.34:0/2192402550 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.34:0/2192402550' 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.524608] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: , client address: IPv4 10.20.193.14:49708 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.529525] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:28:46.626 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.529547] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:46.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_3, OMAP version: 104 2026-02-18T03:28:46.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:46] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.624251] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:46.627 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:46.624278] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:46.627 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:28:46.648 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:46.648 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:46.648 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage8 2026-02-18T03:28:46.649 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage8 --load-balancing-group 1 2026-02-18T03:28:46.688 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO state.py:1684 (2): Start update from 102 to 103 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:46.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO state.py:1684 (129): Start update from 102 to 103 (discovery-trial177). 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO state.py:2068 (129): Update complete (102 -> 103) (discovery-trial177). 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:46.377134] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.177:0/1380252686, rc 0 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:46.377185] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.177:0/1380252686 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.177:0/1380252686' 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:46.387630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:46.392408] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:46.392429] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:46.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] INFO state.py:2068 (2): Update complete (102 -> 103) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:46.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO state.py:1684 (108): Start update from 102 to 103 (discovery-trial155). 2026-02-18T03:28:46.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO state.py:2068 (108): Update complete (102 -> 103) (discovery-trial155). 2026-02-18T03:28:46.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO state.py:1684 (2): Start update from 102 to 103 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:46.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:46.373740] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.155:0/1967987700, rc 0 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:46.373815] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.155:0/1967987700 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.155:0/1967987700' 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:46.385626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:46.390575] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:46.390596] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] INFO state.py:2068 (2): Update complete (102 -> 103) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:46.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:46] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.204 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:46 trial034 ceph-mon[21825]: pgmap v169: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 509 KiB/s rd, 4.2 KiB/s wr, 255 op/s 2026-02-18T03:28:47.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:1684 (84): Start update from 103 to 104 (discovery-trial034). 2026-02-18T03:28:47.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:2068 (84): Update complete (103 -> 104) (discovery-trial034). 2026-02-18T03:28:47.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:59088 2026-02-18T03:28:47.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage8, no need to remove 2026-02-18T03:28:47.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:47.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:47.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:59088 2026-02-18T03:28:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:46 trial155 ceph-mon[24719]: pgmap v169: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 509 KiB/s rd, 4.2 KiB/s wr, 255 op/s 2026-02-18T03:28:47.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:1684 (108): Start update from 103 to 104 (discovery-trial155). 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:2068 (108): Update complete (103 -> 104) (discovery-trial155). 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 103 to 104 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.074255] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.155:0/2334613056, rc 0 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.074324] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.155:0/2334613056 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.155:0/2334613056' 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.084343] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.089143] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:28:47.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.089167] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:47.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (103 -> 104) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:47.249 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:46 trial086 ceph-mon[24100]: pgmap v169: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 509 KiB/s rd, 4.2 KiB/s wr, 255 op/s 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:1684 (141): Start update from 103 to 104 (discovery-trial086). 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:2068 (141): Update complete (103 -> 104) (discovery-trial086). 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 103 to 104 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.073548] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.86:0/877623700, rc 0 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.073612] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.86:0/877623700 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.86:0/877623700' 2026-02-18T03:28:47.249 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.083605] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:47.250 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:28:47.250 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.088320] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:28:47.250 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.088340] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:47.250 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (103 -> 104) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:47.250 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.340 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode2: Successful 2026-02-18T03:28:47.366 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:47.367 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:47.367 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2026-02-18T03:28:47.367 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:47.368 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:47.368 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage9 2026-02-18T03:28:47.368 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage9 --load-balancing-group 2 2026-02-18T03:28:47.415 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:1684 (129): Start update from 103 to 104 (discovery-trial177). 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:2068 (129): Update complete (103 -> 104) (discovery-trial177). 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 103 to 104 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.076392] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.177:0/1671481638, rc 0 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.076444] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.177:0/1671481638 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.177:0/1671481638' 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.087320] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.092172] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.092193] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (103 -> 104) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:47.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.225557] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.34:0/3854202423, rc 0 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.225624] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.34:0/3854202423 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.34:0/3854202423' 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.235565] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: , client address: IPv4 10.20.193.14:59088 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.240000] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.240023] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode2_4, OMAP version: 105 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.336147] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:47.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.336176] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:47.622 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:47.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3835573210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2720609833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:1684 (84): Start update from 104 to 105 (discovery-trial034). 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:2068 (84): Update complete (104 -> 105) (discovery-trial034). 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:33740 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage9, no need to remove 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:33740 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.932059] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.34:0/2178413503, rc 0 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.932114] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.34:0/2178413503 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.34:0/2178413503' 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.942363] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: , client address: IPv4 10.20.193.14:33740 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.947016] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:47.947038] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_1, OMAP version: 106 2026-02-18T03:28:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:47] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.049 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:28:48.069 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:48.069 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:48.070 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage10 2026-02-18T03:28:48.070 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage10 --load-balancing-group 3 2026-02-18T03:28:48.108 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:48.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3835573210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/2720609833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:1684 (141): Start update from 104 to 105 (discovery-trial086). 2026-02-18T03:28:48.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:2068 (141): Update complete (104 -> 105) (discovery-trial086). 2026-02-18T03:28:48.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 104 to 105 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.788328] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.86:0/2756543059, rc 0 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.788626] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.86:0/2756543059 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.86:0/2756543059' 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.798308] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.802737] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:47.802757] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (104 -> 105) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:48.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:47] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 104 to 105 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:48.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:1684 (129): Start update from 104 to 105 (discovery-trial177). 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:2068 (129): Update complete (104 -> 105) (discovery-trial177). 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.784508] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.177:0/2373116628, rc 0 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.784562] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.177:0/2373116628 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.177:0/2373116628' 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.795251] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.799632] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:47.799651] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (104 -> 105) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3835573210' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2720609833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:48.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:1684 (2): Start update from 104 to 105 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:1684 (108): Start update from 104 to 105 (discovery-trial155). 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:2068 (108): Update complete (104 -> 105) (discovery-trial155). 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.784885] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.155:0/3639508160, rc 0 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.784941] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.155:0/3639508160 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.155:0/3639508160' 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.794596] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.799114] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:28:48.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:47.799139] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:48.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] INFO state.py:2068 (2): Update complete (104 -> 105) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:48.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:47] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.046105] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:48.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.046136] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO state.py:1684 (2): Start update from 105 to 106 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO state.py:1684 (108): Start update from 105 to 106 (discovery-trial155). 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO state.py:2068 (108): Update complete (105 -> 106) (discovery-trial155). 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:48.490901] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.155:0/3310866430, rc 0 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:48.490972] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.155:0/3310866430 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.155:0/3310866430' 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:48.513027] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:48.522309] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:48.522345] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] INFO state.py:2068 (2): Update complete (105 -> 106) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:48.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO state.py:1684 (84): Start update from 105 to 106 (discovery-trial034). 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO state.py:2068 (84): Update complete (105 -> 106) (discovery-trial034). 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:38470 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage10, no need to remove 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:38470 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.634785] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.34:0/1694901223, rc 0 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.635068] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.34:0/1694901223 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.34:0/1694901223' 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.644893] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: , client address: IPv4 10.20.193.14:38470 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.649431] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.649450] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_2, OMAP version: 107 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.754312] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:48.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:48.754335] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:48.757 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:28:48.778 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:48.779 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:48.779 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage11 2026-02-18T03:28:48.779 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage11 --load-balancing-group 4 2026-02-18T03:28:48.811 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO state.py:1684 (2): Start update from 105 to 106 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO state.py:1684 (141): Start update from 105 to 106 (discovery-trial086). 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO state.py:2068 (141): Update complete (105 -> 106) (discovery-trial086). 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:48.492603] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.86:0/3479154558, rc 0 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:48.493621] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.86:0/3479154558 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.86:0/3479154558' 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:48.504627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:48.513850] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:48.513871] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] INFO state.py:2068 (2): Update complete (105 -> 106) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO state.py:1684 (129): Start update from 105 to 106 (discovery-trial177). 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO state.py:2068 (129): Update complete (105 -> 106) (discovery-trial177). 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO state.py:1684 (2): Start update from 105 to 106 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:48.495638] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.177:0/2730877467, rc 0 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:48.496328] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.177:0/2730877467 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.177:0/2730877467' 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:48.507443] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:48.511987] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:48.512011] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] INFO state.py:2068 (2): Update complete (105 -> 106) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:48] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:48 trial034 ceph-mon[21825]: pgmap v170: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 3.4 KiB/s wr, 302 op/s 2026-02-18T03:28:49.203 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:48 trial086 ceph-mon[24100]: pgmap v170: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 3.4 KiB/s wr, 302 op/s 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:1684 (141): Start update from 106 to 107 (discovery-trial086). 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:2068 (141): Update complete (106 -> 107) (discovery-trial086). 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 106 to 107 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:49.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.193170] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.86:0/441819740, rc 0 2026-02-18T03:28:49.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.193234] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.86:0/441819740 2026-02-18T03:28:49.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.86:0/441819740' 2026-02-18T03:28:49.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.202642] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:49.209 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:48 trial155 ceph-mon[24719]: pgmap v170: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 3.4 KiB/s wr, 302 op/s 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:1684 (108): Start update from 106 to 107 (discovery-trial155). 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:2068 (108): Update complete (106 -> 107) (discovery-trial155). 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 106 to 107 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.197273] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.155:0/1094306147, rc 0 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.198023] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.155:0/1094306147 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.155:0/1094306147' 2026-02-18T03:28:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.208194] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:1684 (129): Start update from 106 to 107 (discovery-trial177). 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:2068 (129): Update complete (106 -> 107) (discovery-trial177). 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 106 to 107 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.199855] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.177:0/1828901458, rc 0 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.199914] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.177:0/1828901458 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.177:0/1828901458' 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.210595] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:28:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.215117] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:28:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.215139] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (106 -> 107) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:1684 (84): Start update from 106 to 107 (discovery-trial034). 2026-02-18T03:28:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:2068 (84): Update complete (106 -> 107) (discovery-trial034). 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:41918 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage11, no need to remove 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:41918 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.350486] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.34:0/2963771118, rc 0 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.351074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.34:0/2963771118 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.34:0/2963771118' 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.361552] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: , client address: IPv4 10.20.193.14:41918 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.366401] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.366422] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_3, OMAP version: 108 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.472545] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:49.472571] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:49.476 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.212790] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.212814] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (106 -> 107) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.498 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:49.498 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:49.498 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage12 2026-02-18T03:28:49.498 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage12 --load-balancing-group 1 2026-02-18T03:28:49.531 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:49Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:28:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.207248] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:28:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.207278] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (106 -> 107) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:1684 (84): Start update from 107 to 108 (discovery-trial034). 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO state.py:2068 (84): Update complete (107 -> 108) (discovery-trial034). 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:58860 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage12, no need to remove 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:58860 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.076763] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.34:0/893480404, rc 0 2026-02-18T03:28:50.178 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.077070] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.34:0/893480404 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.34:0/893480404' 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.086815] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: , client address: IPv4 10.20.193.14:58860 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.091843] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.091862] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode3_4, OMAP version: 109 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.176769] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:50.179 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.176796] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:50.180 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode3: Successful 2026-02-18T03:28:50.202 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:50.202 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:50.202 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode4 2026-02-18T03:28:50.202 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:50.203 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:50.203 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage13 2026-02-18T03:28:50.203 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode4 --rbd-pool mypool --rbd-image myimage13 --load-balancing-group 2 2026-02-18T03:28:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 107 to 108 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:1684 (129): Start update from 107 to 108 (discovery-trial177). 2026-02-18T03:28:50.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:2068 (129): Update complete (107 -> 108) (discovery-trial177). 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.911097] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.177:0/2378330179, rc 0 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.911148] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.177:0/2378330179 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.177:0/2378330179' 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.920897] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.926001] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:49.926021] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (107 -> 108) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:1684 (108): Start update from 107 to 108 (discovery-trial155). 2026-02-18T03:28:50.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:2068 (108): Update complete (107 -> 108) (discovery-trial155). 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 107 to 108 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.912588] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.155:0/284319486, rc 0 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.916031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.155:0/284319486 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.155:0/284319486' 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.926002] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.931149] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:28:50.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:49.931171] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:49 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (107 -> 108) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.236 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:50.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:1684 (141): Start update from 107 to 108 (discovery-trial086). 2026-02-18T03:28:50.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:2068 (141): Update complete (107 -> 108) (discovery-trial086). 2026-02-18T03:28:50.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:1684 (2): Start update from 107 to 108 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.907104] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.86:0/3606253196, rc 0 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.907371] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.86:0/3606253196 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.86:0/3606253196' 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.916723] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.921406] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:49.921426] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:49] INFO state.py:2068 (2): Update complete (107 -> 108) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:50.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO state.py:1684 (2): Start update from 108 to 109 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:50.618 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO state.py:1684 (108): Start update from 108 to 109 (discovery-trial155). 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO state.py:1684 (141): Start update from 108 to 109 (discovery-trial086). 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO state.py:2068 (141): Update complete (108 -> 109) (discovery-trial086). 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO state.py:1684 (2): Start update from 108 to 109 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:50.633092] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.86:0/1528221804, rc 0 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:50.633617] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.86:0/1528221804 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.86:0/1528221804' 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:50.643572] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:50.648737] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:50.648759] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] INFO state.py:2068 (2): Update complete (108 -> 109) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:50] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:1684 (84): Start update from 108 to 109 (discovery-trial034). 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:2068 (84): Update complete (108 -> 109) (discovery-trial034). 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:42718 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage13, no need to remove 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:42718 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.768921] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.34:0/2768752310, rc 0 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.768985] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.34:0/2768752310 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.34:0/2768752310' 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.778392] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: , client address: IPv4 10.20.193.14:42718 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.782826] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.782848] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode4_1, OMAP version: 110 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.884404] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:50.885 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:50.884432] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:50.887 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:28:50.908 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:50.908 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:50.908 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage14 2026-02-18T03:28:50.908 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode4 --rbd-pool mypool --rbd-image myimage14 --load-balancing-group 3 2026-02-18T03:28:50.955 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO state.py:2068 (108): Update complete (108 -> 109) (discovery-trial155). 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:50.638805] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.155:0/2346816721, rc 0 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:50.639023] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.155:0/2346816721 2026-02-18T03:28:50.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.155:0/2346816721' 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:50.648719] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:50.653581] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:50.653603] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] INFO state.py:2068 (2): Update complete (108 -> 109) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO state.py:1684 (2): Start update from 108 to 109 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO state.py:1684 (129): Start update from 108 to 109 (discovery-trial177). 2026-02-18T03:28:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO state.py:2068 (129): Update complete (108 -> 109) (discovery-trial177). 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:50.633832] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.177:0/2750211801, rc 0 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:50.634320] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.177:0/2750211801 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.177:0/2750211801' 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:50.644387] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:50.655529] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:50.655563] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] INFO state.py:2068 (2): Update complete (108 -> 109) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:50] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-mon[24719]: pgmap v171: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 568 op/s 2026-02-18T03:28:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:50 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1226531873' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-mon[21825]: pgmap v171: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 568 op/s 2026-02-18T03:28:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:50 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1226531873' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.302 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-mon[24100]: pgmap v171: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 568 op/s 2026-02-18T03:28:51.302 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:50 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/1226531873' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:51.561 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:1684 (84): Start update from 109 to 110 (discovery-trial034). 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:2068 (84): Update complete (109 -> 110) (discovery-trial034). 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:45432 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage14, no need to remove 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:45432 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.456587] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.34:0/611480970, rc 0 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.456673] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.34:0/611480970 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.34:0/611480970' 2026-02-18T03:28:51.562 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.466017] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: , client address: IPv4 10.20.193.14:45432 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.470700] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.470723] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode4_2, OMAP version: 111 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.560612] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:51.563 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:51.560639] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:51.564 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:28:51.585 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:51.585 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:51.585 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage15 2026-02-18T03:28:51.585 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode4 --rbd-pool mypool --rbd-image myimage15 --load-balancing-group 4 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 109 to 110 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:1684 (141): Start update from 109 to 110 (discovery-trial086). 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:2068 (141): Update complete (109 -> 110) (discovery-trial086). 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:51.328134] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.86:0/3580408777, rc 0 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:51.328196] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.86:0/3580408777 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.86:0/3580408777' 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:51.338628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:51.349804] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:51.349830] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:2068 (2): Update complete (109 -> 110) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.627 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:1684 (129): Start update from 109 to 110 (discovery-trial177). 2026-02-18T03:28:51.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:2068 (129): Update complete (109 -> 110) (discovery-trial177). 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 109 to 110 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:51.329353] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.177:0/3297775321, rc 0 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:51.329404] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.177:0/3297775321 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.177:0/3297775321' 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:51.340068] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:51.344540] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:28:51.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:51.344560] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:2068 (2): Update complete (109 -> 110) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:1684 (108): Start update from 109 to 110 (discovery-trial155). 2026-02-18T03:28:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:2068 (108): Update complete (109 -> 110) (discovery-trial155). 2026-02-18T03:28:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 109 to 110 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:51.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:51.325431] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.155:0/1418479349, rc 0 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:51.326029] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.155:0/1418479349 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.155:0/1418479349' 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:51.336450] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:51.341014] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:51.341036] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:2068 (2): Update complete (109 -> 110) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:51.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.240 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:28:52.259 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:52.259 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:52.259 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage16 2026-02-18T03:28:52.259 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode4 --rbd-pool mypool --rbd-image myimage16 --load-balancing-group 1 2026-02-18T03:28:52.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:1684 (84): Start update from 110 to 111 (discovery-trial034). 2026-02-18T03:28:52.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:51] INFO state.py:2068 (84): Update complete (110 -> 111) (discovery-trial034). 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:56084 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage15, no need to remove 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:56084 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.132709] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.34:0/2824107179, rc 0 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.132773] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.34:0/2824107179 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.34:0/2824107179' 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.141893] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: , client address: IPv4 10.20.193.14:56084 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.146419] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.146441] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode4_3, OMAP version: 112 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.236222] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.236254] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:52.302 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:52.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 110 to 111 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:52.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:1684 (141): Start update from 110 to 111 (discovery-trial086). 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:51 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:51] INFO state.py:2068 (141): Update complete (110 -> 111) (discovery-trial086). 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.010589] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.86:0/1362266951, rc 0 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.010654] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.86:0/1362266951 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.86:0/1362266951' 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.020631] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.028899] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:28:52.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.028925] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (110 -> 111) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:1684 (129): Start update from 110 to 111 (discovery-trial177). 2026-02-18T03:28:52.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:2068 (129): Update complete (110 -> 111) (discovery-trial177). 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 110 to 111 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.016502] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.177:0/1162000373, rc 0 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.016553] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.177:0/1162000373 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.177:0/1162000373' 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.026030] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.030548] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:28:52.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.030568] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:52.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (110 -> 111) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:52.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:1684 (2): Start update from 110 to 111 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:1684 (108): Start update from 110 to 111 (discovery-trial155). 2026-02-18T03:28:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO state.py:2068 (108): Update complete (110 -> 111) (discovery-trial155). 2026-02-18T03:28:52.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:51 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.016847] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.155:0/1175800985, rc 0 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.016914] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.155:0/1175800985 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.155:0/1175800985' 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.026579] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.031052] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.031076] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (110 -> 111) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:52.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO state.py:1684 (2): Start update from 111 to 112 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO state.py:1684 (129): Start update from 111 to 112 (discovery-trial177). 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO state.py:2068 (129): Update complete (111 -> 112) (discovery-trial177). 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.686607] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.177:0/2341232960, rc 0 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.686659] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.177:0/2341232960 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.177:0/2341232960' 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.696573] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:28:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.701156] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:28:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:52.701176] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (111 -> 112) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:52] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:1684 (84): Start update from 111 to 112 (discovery-trial034). 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:2068 (84): Update complete (111 -> 112) (discovery-trial034). 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:38434 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage16, no need to remove 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:38434 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.852268] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.34:0/1573613329, rc 0 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.852337] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.34:0/1573613329 2026-02-18T03:28:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.34:0/1573613329' 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.862188] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: , client address: IPv4 10.20.193.14:38434 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.866971] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.866994] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode4_4, OMAP version: 113 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:52] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.964059] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:52.964088] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:52.968 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode4: Successful 2026-02-18T03:28:52.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO state.py:1684 (108): Start update from 111 to 112 (discovery-trial155). 2026-02-18T03:28:52.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO state.py:2068 (108): Update complete (111 -> 112) (discovery-trial155). 2026-02-18T03:28:52.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO state.py:1684 (2): Start update from 111 to 112 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.694751] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.155:0/3419963886, rc 0 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.694820] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.155:0/3419963886 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.155:0/3419963886' 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.704776] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.709374] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:52.709396] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (111 -> 112) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO state.py:1684 (141): Start update from 111 to 112 (discovery-trial086). 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO state.py:2068 (141): Update complete (111 -> 112) (discovery-trial086). 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO state.py:1684 (2): Start update from 111 to 112 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.692737] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.86:0/4011973474, rc 0 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.692796] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.86:0/4011973474 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.86:0/4011973474' 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.702485] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:28:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.707085] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:28:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:52.707109] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] INFO state.py:2068 (2): Update complete (111 -> 112) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:52] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:52.989 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:52.989 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:52.989 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode5 2026-02-18T03:28:52.989 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:52.990 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:52.990 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage17 2026-02-18T03:28:52.990 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode5 --rbd-pool mypool --rbd-image myimage17 --load-balancing-group 2 2026-02-18T03:28:53.030 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-mon[24719]: pgmap v172: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 953 KiB/s rd, 5.8 KiB/s wr, 746 op/s 2026-02-18T03:28:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:52 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3039467090' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-mon[21825]: pgmap v172: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 953 KiB/s rd, 5.8 KiB/s wr, 746 op/s 2026-02-18T03:28:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3039467090' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-mon[24100]: pgmap v172: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 953 KiB/s rd, 5.8 KiB/s wr, 746 op/s 2026-02-18T03:28:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:52 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3039467090' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO state.py:1684 (84): Start update from 112 to 113 (discovery-trial034). 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO state.py:2068 (84): Update complete (112 -> 113) (discovery-trial034). 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:58150 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage17, no need to remove 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:53.662 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:58150 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.556127] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.34:0/32649674, rc 0 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.556198] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.34:0/32649674 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.34:0/32649674' 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.565751] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: , client address: IPv4 10.20.193.14:58150 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.570831] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.570853] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode5_1, OMAP version: 114 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:53] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.663 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.660941] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:53.664 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:53.660966] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:53.664 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:28:53.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO state.py:1684 (2): Start update from 112 to 113 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:53.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:53.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO state.py:1684 (129): Start update from 112 to 113 (discovery-trial177). 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO state.py:2068 (129): Update complete (112 -> 113) (discovery-trial177). 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:53.417087] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.177:0/3195859669, rc 0 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:53.417329] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.177:0/3195859669 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.177:0/3195859669' 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:53.427333] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:53.450567] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:53.450599] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] INFO state.py:2068 (2): Update complete (112 -> 113) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:53.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:53] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO state.py:1684 (108): Start update from 112 to 113 (discovery-trial155). 2026-02-18T03:28:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO state.py:2068 (108): Update complete (112 -> 113) (discovery-trial155). 2026-02-18T03:28:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO state.py:1684 (2): Start update from 112 to 113 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:53.417042] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.155:0/284910265, rc 0 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:53.417112] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.155:0/284910265 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.155:0/284910265' 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:53.428227] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:53.433187] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:53.433210] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] INFO state.py:2068 (2): Update complete (112 -> 113) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:53 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO state.py:1684 (141): Start update from 112 to 113 (discovery-trial086). 2026-02-18T03:28:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO state.py:2068 (141): Update complete (112 -> 113) (discovery-trial086). 2026-02-18T03:28:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO state.py:1684 (2): Start update from 112 to 113 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:53.410975] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.86:0/1471559843, rc 0 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:53.411048] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.86:0/1471559843 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.86:0/1471559843' 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:53.420005] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:53.424690] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:53.424719] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] INFO state.py:2068 (2): Update complete (112 -> 113) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:53] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:53.898 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:53.898 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:53.899 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage18 2026-02-18T03:28:53.899 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode5 --rbd-pool mypool --rbd-image myimage18 --load-balancing-group 3 2026-02-18T03:28:53.984 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:1684 (84): Start update from 113 to 114 (discovery-trial034). 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:2068 (84): Update complete (113 -> 114) (discovery-trial034). 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:42452 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage18, no need to remove 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:54.358 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:42452 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.325339] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.34:0/1790911656, rc 0 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.326088] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.34:0/1790911656 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.34:0/1790911656' 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.337079] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: , client address: IPv4 10.20.193.14:42452 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.357274] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:28:54.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.357304] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:54.366 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 113 to 114 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:54.366 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:54.366 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:54.366 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:1684 (129): Start update from 113 to 114 (discovery-trial177). 2026-02-18T03:28:54.366 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:2068 (129): Update complete (113 -> 114) (discovery-trial177). 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.106486] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.177:0/2599069061, rc 0 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.106538] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.177:0/2599069061 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.177:0/2599069061' 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.115764] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.120561] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.120582] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (113 -> 114) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:54.367 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 113 to 114 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:1684 (141): Start update from 113 to 114 (discovery-trial086). 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:2068 (141): Update complete (113 -> 114) (discovery-trial086). 2026-02-18T03:28:54.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.112623] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.86:0/3898650419, rc 0 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.112696] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.86:0/3898650419 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.86:0/3898650419' 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.121660] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.126303] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.126324] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (113 -> 114) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:54.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:1684 (108): Start update from 113 to 114 (discovery-trial155). 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:2068 (108): Update complete (113 -> 114) (discovery-trial155). 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 113 to 114 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.116720] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.155:0/1732445572, rc 0 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.116788] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.155:0/1732445572 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.155:0/1732445572' 2026-02-18T03:28:54.370 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.125733] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:54.371 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:28:54.371 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.130879] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:28:54.371 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.130901] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:54.371 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (113 -> 114) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:54.371 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.462 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:28:54.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.687 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:54.687 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:54.688 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage19 2026-02-18T03:28:54.688 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode5 --rbd-pool mypool --rbd-image myimage19 --load-balancing-group 4 2026-02-18T03:28:54.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode5_2, OMAP version: 115 2026-02-18T03:28:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.457920] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:54.457948] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:54.773 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:55.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-mon[21825]: pgmap v173: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 982 KiB/s rd, 4.8 KiB/s wr, 891 op/s 2026-02-18T03:28:55.131 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2336424987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:55.131 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:1684 (84): Start update from 114 to 115 (discovery-trial034). 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:54] INFO state.py:2068 (84): Update complete (114 -> 115) (discovery-trial034). 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:43034 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage19, no need to remove 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:43034 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.106047] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.34:0/1500801273, rc 0 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.116080] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.34:0/1500801273 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.34:0/1500801273' 2026-02-18T03:28:55.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.126071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.133 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: , client address: IPv4 10.20.193.14:43034 2026-02-18T03:28:55.133 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.130583] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:28:55.133 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.130607] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:55.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-mon[24100]: pgmap v173: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 982 KiB/s rd, 4.8 KiB/s wr, 891 op/s 2026-02-18T03:28:55.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2336424987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:55.141 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:1684 (141): Start update from 114 to 115 (discovery-trial086). 2026-02-18T03:28:55.141 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:2068 (141): Update complete (114 -> 115) (discovery-trial086). 2026-02-18T03:28:55.141 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 114 to 115 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:55.141 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.907129] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.86:0/316816502, rc 0 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.907201] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.86:0/316816502 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.86:0/316816502' 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.916272] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.920721] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:54.920743] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (114 -> 115) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:55.142 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.143 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-mon[24719]: pgmap v173: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 982 KiB/s rd, 4.8 KiB/s wr, 891 op/s 2026-02-18T03:28:55.143 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2336424987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:1684 (108): Start update from 114 to 115 (discovery-trial155). 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:2068 (108): Update complete (114 -> 115) (discovery-trial155). 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 114 to 115 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.910632] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.155:0/554138805, rc 0 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.910709] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.155:0/554138805 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.155:0/554138805' 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.921731] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.144 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.926346] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:54.926366] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (114 -> 115) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:1684 (2): Start update from 114 to 115 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:55.145 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:1684 (129): Start update from 114 to 115 (discovery-trial177). 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:2068 (129): Update complete (114 -> 115) (discovery-trial177). 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.900713] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.177:0/2736666226, rc 0 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.901329] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.177:0/2736666226 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.177:0/2736666226' 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.911332] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.928587] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:54.928610] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:54] INFO state.py:2068 (2): Update complete (114 -> 115) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.234 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:28:55.254 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:55.254 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:55.255 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage20 2026-02-18T03:28:55.255 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode5 --rbd-pool mypool --rbd-image myimage20 --load-balancing-group 1 2026-02-18T03:28:55.296 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:55.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode5_3, OMAP version: 116 2026-02-18T03:28:55.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.230182] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.230216] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:55.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO state.py:1684 (129): Start update from 115 to 116 (discovery-trial177). 2026-02-18T03:28:55.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO state.py:1684 (2): Start update from 115 to 116 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO state.py:2068 (129): Update complete (115 -> 116) (discovery-trial177). 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:55.680780] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.177:0/2996250956, rc 0 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:55.680833] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.177:0/2996250956 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.177:0/2996250956' 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:55.690757] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:55.695262] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:28:55.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:55.695282] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:55.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] INFO state.py:2068 (2): Update complete (115 -> 116) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:55.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:55 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:1684 (84): Start update from 115 to 116 (discovery-trial034). 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:2068 (84): Update complete (115 -> 116) (discovery-trial034). 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:51792 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage20, no need to remove 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:51792 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.842862] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.34:0/424276963, rc 0 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.854081] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.34:0/424276963 2026-02-18T03:28:55.976 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.34:0/424276963' 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.864744] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: , client address: IPv4 10.20.193.14:51792 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.869308] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.869330] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode5_4, OMAP version: 117 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:55] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.975061] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:55.977 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:55.975091] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO state.py:1684 (108): Start update from 115 to 116 (discovery-trial155). 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO state.py:2068 (108): Update complete (115 -> 116) (discovery-trial155). 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO state.py:1684 (2): Start update from 115 to 116 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:55.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:55.682025] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.155:0/3044491763, rc 0 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:55.682099] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.155:0/3044491763 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.155:0/3044491763' 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:55.692597] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:55.697129] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:55.697150] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] INFO state.py:2068 (2): Update complete (115 -> 116) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:55 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:55.980 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode5: Successful 2026-02-18T03:28:56.001 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:56.001 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:56.001 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode6 2026-02-18T03:28:56.002 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:56.003 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:56.003 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage21 2026-02-18T03:28:56.003 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode6 --rbd-pool mypool --rbd-image myimage21 --load-balancing-group 2 2026-02-18T03:28:56.037 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:56.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO state.py:1684 (141): Start update from 115 to 116 (discovery-trial086). 2026-02-18T03:28:56.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO state.py:2068 (141): Update complete (115 -> 116) (discovery-trial086). 2026-02-18T03:28:56.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO state.py:1684 (2): Start update from 115 to 116 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:56.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:56.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:55.680318] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.86:0/2266268349, rc 0 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:55.680381] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.86:0/2266268349 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.86:0/2266268349' 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:55.689848] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:55.694400] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:55.694425] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] INFO state.py:2068 (2): Update complete (115 -> 116) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:55] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO state.py:1684 (84): Start update from 116 to 117 (discovery-trial034). 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO state.py:2068 (84): Update complete (116 -> 117) (discovery-trial034). 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:43304 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage21, no need to remove 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:43304 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.559043] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.34:0/606617271, rc 0 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.559110] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.34:0/606617271 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.34:0/606617271' 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.570078] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: , client address: IPv4 10.20.193.14:43304 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.579331] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.579364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode6_1, OMAP version: 118 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.669222] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:56.669246] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:56.672 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:28:56.693 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:56.693 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:56.693 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage22 2026-02-18T03:28:56.694 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode6 --rbd-pool mypool --rbd-image myimage22 --load-balancing-group 3 2026-02-18T03:28:56.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO state.py:1684 (129): Start update from 116 to 117 (discovery-trial177). 2026-02-18T03:28:56.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO state.py:2068 (129): Update complete (116 -> 117) (discovery-trial177). 2026-02-18T03:28:56.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO state.py:1684 (2): Start update from 116 to 117 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:56.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:56.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:56.419132] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.177:0/3925188939, rc 0 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:56.419183] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.177:0/3925188939 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.177:0/3925188939' 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:56.429234] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:56.433779] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:56.433799] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] INFO state.py:2068 (2): Update complete (116 -> 117) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO state.py:1684 (108): Start update from 116 to 117 (discovery-trial155). 2026-02-18T03:28:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO state.py:2068 (108): Update complete (116 -> 117) (discovery-trial155). 2026-02-18T03:28:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO state.py:1684 (2): Start update from 116 to 117 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:56.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:56.420997] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.155:0/4176579075, rc 0 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:56.421067] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.155:0/4176579075 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.155:0/4176579075' 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:56.431361] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:56.436043] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:56.436064] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] INFO state.py:2068 (2): Update complete (116 -> 117) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.736 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO state.py:1684 (141): Start update from 116 to 117 (discovery-trial086). 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO state.py:1684 (2): Start update from 116 to 117 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO state.py:2068 (141): Update complete (116 -> 117) (discovery-trial086). 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:56.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:56.414214] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.86:0/88620494, rc 0 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:56.414633] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.86:0/88620494 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.86:0/88620494' 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:56.432627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:56.440794] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:56.440818] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] INFO state.py:2068 (2): Update complete (116 -> 117) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:56.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:56] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.237 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:56 trial034 ceph-mon[21825]: pgmap v174: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.2 KiB/s wr, 1.11k op/s 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:1684 (84): Start update from 117 to 118 (discovery-trial034). 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:2068 (84): Update complete (117 -> 118) (discovery-trial034). 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:56932 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage22, no need to remove 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:57.238 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:56932 2026-02-18T03:28:57.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.237131] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.34:0/3773067701, rc 0 2026-02-18T03:28:57.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.237189] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.34:0/3773067701 2026-02-18T03:28:57.263 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:56 trial086 ceph-mon[24100]: pgmap v174: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.2 KiB/s wr, 1.11k op/s 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 117 to 118 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:1684 (141): Start update from 117 to 118 (discovery-trial086). 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:2068 (141): Update complete (117 -> 118) (discovery-trial086). 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.119530] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.86:0/884256450, rc 0 2026-02-18T03:28:57.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.119601] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.86:0/884256450 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.86:0/884256450' 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.129130] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.133971] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.133993] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (117 -> 118) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:57.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.265 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:56 trial155 ceph-mon[24719]: pgmap v174: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.2 KiB/s wr, 1.11k op/s 2026-02-18T03:28:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:1684 (108): Start update from 117 to 118 (discovery-trial155). 2026-02-18T03:28:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:2068 (108): Update complete (117 -> 118) (discovery-trial155). 2026-02-18T03:28:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 117 to 118 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:57.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.127765] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.155:0/3196265666, rc 0 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.127831] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.155:0/3196265666 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.155:0/3196265666' 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.137623] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.142154] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.142178] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (117 -> 118) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:57.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.344 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:28:57.366 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:57.366 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:57.366 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage23 2026-02-18T03:28:57.366 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode6 --rbd-pool mypool --rbd-image myimage23 --load-balancing-group 4 2026-02-18T03:28:57.400 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:57Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:1684 (129): Start update from 117 to 118 (discovery-trial177). 2026-02-18T03:28:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:2068 (129): Update complete (117 -> 118) (discovery-trial177). 2026-02-18T03:28:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 117 to 118 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:57.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.125779] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.177:0/3725338589, rc 0 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.125844] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.177:0/3725338589 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.177:0/3725338589' 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.135753] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.140598] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.140619] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (117 -> 118) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.34:0/3773067701' 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.246372] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: , client address: IPv4 10.20.193.14:56932 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.251210] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.251230] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode6_2, OMAP version: 119 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.339946] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:57.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.339969] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:57.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:57.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.036 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3635698865' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:58.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:1684 (84): Start update from 118 to 119 (discovery-trial034). 2026-02-18T03:28:58.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:2068 (84): Update complete (118 -> 119) (discovery-trial034). 2026-02-18T03:28:58.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:48348 2026-02-18T03:28:58.037 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage23, no need to remove 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:48348 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.928119] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.34:0/43132206, rc 0 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.928200] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.34:0/43132206 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.34:0/43132206' 2026-02-18T03:28:58.038 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.937490] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: , client address: IPv4 10.20.193.14:48348 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.942141] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:57.942164] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode6_3, OMAP version: 120 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:57] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.035641] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:58.039 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.035671] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:58.040 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:28:58.060 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:58.061 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:58.061 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage24 2026-02-18T03:28:58.061 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode6 --rbd-pool mypool --rbd-image myimage24 --load-balancing-group 1 2026-02-18T03:28:58.094 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:58.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3635698865' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:58.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:1684 (141): Start update from 118 to 119 (discovery-trial086). 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:2068 (141): Update complete (118 -> 119) (discovery-trial086). 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 118 to 119 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.797559] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.86:0/3719306600, rc 0 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.797632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.86:0/3719306600 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.86:0/3719306600' 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.806200] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:28:58.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.810760] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:28:58.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:57.810782] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:58.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (118 -> 119) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:58.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:57] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 118 to 119 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:1684 (129): Start update from 118 to 119 (discovery-trial177). 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:2068 (129): Update complete (118 -> 119) (discovery-trial177). 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.788505] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.177:0/3738187524, rc 0 2026-02-18T03:28:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.788568] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.177:0/3738187524 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.177:0/3738187524' 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.798796] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.803261] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:57.803281] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (118 -> 119) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:57] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3635698865' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:28:58.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:1684 (108): Start update from 118 to 119 (discovery-trial155). 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:1684 (2): Start update from 118 to 119 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:2068 (108): Update complete (118 -> 119) (discovery-trial155). 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.798057] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.155:0/167188958, rc 0 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.799030] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.155:0/167188958 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.155:0/167188958' 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.809088] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:28:58.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.813847] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:28:58.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:57.813868] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:28:58.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] INFO state.py:2068 (2): Update complete (118 -> 119) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:58.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:57] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO state.py:1684 (2): Start update from 119 to 120 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO state.py:1684 (129): Start update from 119 to 120 (discovery-trial177). 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO state.py:2068 (129): Update complete (119 -> 120) (discovery-trial177). 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:58.487332] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.177:0/2818509842, rc 0 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:58.488331] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.177:0/2818509842 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.177:0/2818509842' 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:58.499323] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:58.509593] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:58.509619] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] INFO state.py:2068 (2): Update complete (119 -> 120) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:58.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:58] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO state.py:1684 (108): Start update from 119 to 120 (discovery-trial155). 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO state.py:2068 (108): Update complete (119 -> 120) (discovery-trial155). 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO state.py:1684 (2): Start update from 119 to 120 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:58.493671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.155:0/1741475991, rc 0 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:58.494031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.155:0/1741475991 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.155:0/1741475991' 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:58.505022] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:58.528223] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:58.528246] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] INFO state.py:2068 (2): Update complete (119 -> 120) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO state.py:1684 (84): Start update from 119 to 120 (discovery-trial034). 2026-02-18T03:28:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO state.py:2068 (84): Update complete (119 -> 120) (discovery-trial034). 2026-02-18T03:28:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:44314 2026-02-18T03:28:58.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage24, no need to remove 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:44314 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.645115] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.34:0/1427790952, rc 0 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.646077] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.34:0/1427790952 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.34:0/1427790952' 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.657067] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: , client address: IPv4 10.20.193.14:44314 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.678285] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.678320] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode6_4, OMAP version: 121 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:58] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.778 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode6: Successful 2026-02-18T03:28:58.798 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:58.798 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:28:58.798 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode7 2026-02-18T03:28:58.798 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:28:58.799 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:58.799 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage25 2026-02-18T03:28:58.799 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode7 --rbd-pool mypool --rbd-image myimage25 --load-balancing-group 2 2026-02-18T03:28:58.839 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO state.py:1684 (2): Start update from 119 to 120 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO state.py:1684 (141): Start update from 119 to 120 (discovery-trial086). 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO state.py:2068 (141): Update complete (119 -> 120) (discovery-trial086). 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:58.490396] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.86:0/4219503551, rc 0 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:58.490461] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.86:0/4219503551 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.86:0/4219503551' 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:58.500815] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:58.505228] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:58.505249] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] INFO state.py:2068 (2): Update complete (119 -> 120) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:58.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:58] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.204 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-mon[21825]: pgmap v175: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.15k op/s 2026-02-18T03:28:59.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.774670] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:59.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:58.774700] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:59.246 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:28:58 trial086 ceph-mon[24100]: pgmap v175: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.15k op/s 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:1684 (141): Start update from 120 to 121 (discovery-trial086). 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:2068 (141): Update complete (120 -> 121) (discovery-trial086). 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 120 to 121 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.245569] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.86:0/3656592512, rc 0 2026-02-18T03:28:59.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.245653] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.86:0/3656592512 2026-02-18T03:28:59.253 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:28:58 trial155 ceph-mon[24719]: pgmap v175: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.15k op/s 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:1684 (108): Start update from 120 to 121 (discovery-trial155). 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:2068 (108): Update complete (120 -> 121) (discovery-trial155). 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 120 to 121 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.253122] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.155:0/1052270993, rc 0 2026-02-18T03:28:59.253 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.253219] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.155:0/1052270993 2026-02-18T03:28:59.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 120 to 121 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:1684 (129): Start update from 120 to 121 (discovery-trial177). 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:2068 (129): Update complete (120 -> 121) (discovery-trial177). 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.230647] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.177:0/74140277, rc 0 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.230709] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.177:0/74140277 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.177:0/74140277' 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.241090] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:59.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:28:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.260523] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:28:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.260546] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (120 -> 121) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:28:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:1684 (84): Start update from 120 to 121 (discovery-trial034). 2026-02-18T03:28:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:2068 (84): Update complete (120 -> 121) (discovery-trial034). 2026-02-18T03:28:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:41340 2026-02-18T03:28:59.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage25, no need to remove 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:41340 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.359070] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.34:0/4099794725, rc 0 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.360065] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.34:0/4099794725 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.34:0/4099794725' 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.371077] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: , client address: IPv4 10.20.193.14:41340 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.378296] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.378328] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:28:59.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode7_1, OMAP version: 122 2026-02-18T03:28:59.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.474375] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:28:59.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:28:59.474406] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:28:59.478 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:28:59.499 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:28:59.499 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:28:59.499 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage26 2026-02-18T03:28:59.499 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode7 --rbd-pool mypool --rbd-image myimage26 --load-balancing-group 3 2026-02-18T03:28:59.539 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:28:59Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.86:0/3656592512' 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.255281] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.259871] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.259892] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:59.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (120 -> 121) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:59.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.155:0/1052270993' 2026-02-18T03:28:59.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.262711] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:28:59.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:28:59.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.267232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:28:59.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.267252] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:28:59.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (120 -> 121) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:28:59.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:28:59.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 121 to 122 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:28:59.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.184 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:1684 (84): Start update from 121 to 122 (discovery-trial034). 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:2068 (84): Update complete (121 -> 122) (discovery-trial034). 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:49910 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage26, no need to remove 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:28:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:28:59] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:49910 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.067479] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.34:0/3295114852, rc 0 2026-02-18T03:29:00.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.068075] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.34:0/3295114852 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.34:0/3295114852' 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.077312] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: , client address: IPv4 10.20.193.14:49910 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.082398] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.082422] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode7_2, OMAP version: 123 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.183718] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:00.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.183750] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:00.187 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:29:00.209 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:00.209 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:00.209 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage27 2026-02-18T03:29:00.209 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode7 --rbd-pool mypool --rbd-image myimage27 --load-balancing-group 4 2026-02-18T03:29:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 121 to 122 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:1684 (129): Start update from 121 to 122 (discovery-trial177). 2026-02-18T03:29:00.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:2068 (129): Update complete (121 -> 122) (discovery-trial177). 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.920696] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.177:0/2932381571, rc 0 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.920759] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.177:0/2932381571 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.177:0/2932381571' 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.931271] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.935954] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:28:59.935976] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:28:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (121 -> 122) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:1684 (108): Start update from 121 to 122 (discovery-trial155). 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:2068 (108): Update complete (121 -> 122) (discovery-trial155). 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:1684 (2): Start update from 121 to 122 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.922934] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.155:0/503240872, rc 0 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.923016] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.155:0/503240872 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.155:0/503240872' 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.933066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.937561] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:28:59.937583] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:28:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (121 -> 122) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.247 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:1684 (141): Start update from 121 to 122 (discovery-trial086). 2026-02-18T03:29:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:2068 (141): Update complete (121 -> 122) (discovery-trial086). 2026-02-18T03:29:00.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.919671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.86:0/1615674140, rc 0 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.919746] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.86:0/1615674140 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.86:0/1615674140' 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.929142] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.933812] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:28:59.933833] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:28:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:28:59] INFO state.py:2068 (2): Update complete (121 -> 122) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO state.py:1684 (141): Start update from 122 to 123 (discovery-trial086). 2026-02-18T03:29:00.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO state.py:2068 (141): Update complete (122 -> 123) (discovery-trial086). 2026-02-18T03:29:00.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO state.py:1684 (2): Start update from 122 to 123 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:00.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:00.629608] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.86:0/2148146206, rc 0 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:00.630623] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.86:0/2148146206 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.86:0/2148146206' 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:00.639630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:00.644375] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:00.644401] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] INFO state.py:2068 (2): Update complete (122 -> 123) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:00.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO state.py:1684 (84): Start update from 122 to 123 (discovery-trial034). 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO state.py:2068 (84): Update complete (122 -> 123) (discovery-trial034). 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:41754 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage27, no need to remove 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:41754 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.771744] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.34:0/2895192093, rc 0 2026-02-18T03:29:00.899 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.772066] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.34:0/2895192093 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.34:0/2895192093' 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.782076] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: , client address: IPv4 10.20.193.14:41754 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.808308] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.808339] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode7_3, OMAP version: 124 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:00] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.897989] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:00.900 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:00.898014] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:00.901 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:29:00.923 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:00.923 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:00.923 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage28 2026-02-18T03:29:00.923 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode7 --rbd-pool mypool --rbd-image myimage28 --load-balancing-group 1 2026-02-18T03:29:00.956 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO state.py:1684 (2): Start update from 122 to 123 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO state.py:1684 (129): Start update from 122 to 123 (discovery-trial177). 2026-02-18T03:29:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO state.py:2068 (129): Update complete (122 -> 123) (discovery-trial177). 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:00.627924] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.177:0/1640292204, rc 0 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:00.627985] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.177:0/1640292204 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.177:0/1640292204' 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:00.637247] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:00.641786] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:00.641808] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] INFO state.py:2068 (2): Update complete (122 -> 123) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:00] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO state.py:1684 (2): Start update from 122 to 123 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO state.py:1684 (108): Start update from 122 to 123 (discovery-trial155). 2026-02-18T03:29:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO state.py:2068 (108): Update complete (122 -> 123) (discovery-trial155). 2026-02-18T03:29:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:00.633348] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.155:0/906754129, rc 0 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:00.633416] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.155:0/906754129 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.155:0/906754129' 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:00.643658] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:00.648227] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:00.648248] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] INFO state.py:2068 (2): Update complete (122 -> 123) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:00] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-mon[21825]: pgmap v176: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.13k op/s 2026-02-18T03:29:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:00 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1093064024' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:01.330 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-mon[24100]: pgmap v176: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.13k op/s 2026-02-18T03:29:01.330 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:00 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/1093064024' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:01.330 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-mon[24719]: pgmap v176: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.13k op/s 2026-02-18T03:29:01.330 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:00 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1093064024' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:01.579 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode7: Successful 2026-02-18T03:29:01.601 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:01.601 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:01.601 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:01.602 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:01.602 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:01.602 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage29 2026-02-18T03:29:01.602 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode8 --rbd-pool mypool --rbd-image myimage29 --load-balancing-group 2 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:1684 (141): Start update from 123 to 124 (discovery-trial086). 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:2068 (141): Update complete (123 -> 124) (discovery-trial086). 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:1684 (2): Start update from 123 to 124 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:01.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:01.352411] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.86:0/4232654428, rc 0 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:01.352476] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.86:0/4232654428 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.86:0/4232654428' 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:01.361864] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:01.366968] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:01.366989] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:2068 (2): Update complete (123 -> 124) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.634 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO state.py:1684 (2): Start update from 123 to 124 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO state.py:1684 (129): Start update from 123 to 124 (discovery-trial177). 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO state.py:2068 (129): Update complete (123 -> 124) (discovery-trial177). 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:01.349917] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.177:0/2711673513, rc 0 2026-02-18T03:29:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:01.349977] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.177:0/2711673513 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.177:0/2711673513' 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:01.359501] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:01.364173] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:01.364195] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] INFO state.py:2068 (2): Update complete (123 -> 124) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:01] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO state.py:1684 (108): Start update from 123 to 124 (discovery-trial155). 2026-02-18T03:29:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO state.py:2068 (108): Update complete (123 -> 124) (discovery-trial155). 2026-02-18T03:29:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO state.py:1684 (2): Start update from 123 to 124 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:01.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:01.356434] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.155:0/4251106796, rc 0 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:01.356500] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.155:0/4251106796 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.155:0/4251106796' 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:01.365280] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:01.369905] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:01.369926] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] INFO state.py:2068 (2): Update complete (123 -> 124) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:01] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:1684 (84): Start update from 123 to 124 (discovery-trial034). 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:2068 (84): Update complete (123 -> 124) (discovery-trial034). 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:58138 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage28, no need to remove 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:58138 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.462268] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.34:0/3570004919, rc 0 2026-02-18T03:29:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.462343] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.34:0/3570004919 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.34:0/3570004919' 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.472133] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: , client address: IPv4 10.20.193.14:58138 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.476592] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.476614] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode7_4, OMAP version: 125 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.576208] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:01.576233] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:02.260 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3301594558' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:02.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:1684 (84): Start update from 124 to 125 (discovery-trial034). 2026-02-18T03:29:02.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:01] INFO state.py:2068 (84): Update complete (124 -> 125) (discovery-trial034). 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:49736 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage29, no need to remove 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:49736 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.144265] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.34:0/1114214990, rc 0 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.144326] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.34:0/1114214990 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.34:0/1114214990' 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.153919] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: , client address: IPv4 10.20.193.14:49736 2026-02-18T03:29:02.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.158525] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.158547] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode8_1, OMAP version: 126 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.259259] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:02.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.259290] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:02.263 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:29:02.286 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:02.286 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:02.286 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage30 2026-02-18T03:29:02.286 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode8 --rbd-pool mypool --rbd-image myimage30 --load-balancing-group 3 2026-02-18T03:29:02.324 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:02Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3301594558' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:1684 (141): Start update from 124 to 125 (discovery-trial086). 2026-02-18T03:29:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:2068 (141): Update complete (124 -> 125) (discovery-trial086). 2026-02-18T03:29:02.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO state.py:1684 (2): Start update from 124 to 125 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.019087] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.86:0/2557187984, rc 0 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.019631] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.86:0/2557187984 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.86:0/2557187984' 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.028629] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.033024] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.033051] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (124 -> 125) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:02.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:1684 (2): Start update from 124 to 125 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:1684 (129): Start update from 124 to 125 (discovery-trial177). 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:2068 (129): Update complete (124 -> 125) (discovery-trial177). 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.024130] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.177:0/3137903162, rc 0 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.024193] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.177:0/3137903162 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.177:0/3137903162' 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.034469] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.039086] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:29:02.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.039109] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:02.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (124 -> 125) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:02.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:01 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3301594558' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:02.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:1684 (2): Start update from 124 to 125 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:02.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:02.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:1684 (108): Start update from 124 to 125 (discovery-trial155). 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:2068 (108): Update complete (124 -> 125) (discovery-trial155). 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.021724] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.155:0/1635496435, rc 0 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.022031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.155:0/1635496435 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.155:0/1635496435' 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.032288] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.037637] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.037660] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (124 -> 125) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:1684 (2): Start update from 125 to 126 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:1684 (129): Start update from 125 to 126 (discovery-trial177). 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:2068 (129): Update complete (125 -> 126) (discovery-trial177). 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:02.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.712359] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.177:0/2499286333, rc 0 2026-02-18T03:29:02.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.713331] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.177:0/2499286333 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:1684 (84): Start update from 125 to 126 (discovery-trial034). 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:2068 (84): Update complete (125 -> 126) (discovery-trial034). 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:37918 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage30, no need to remove 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:02.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:37918 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.855410] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.34:0/456728536, rc 0 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.855479] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.34:0/456728536 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.34:0/456728536' 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.865175] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: , client address: IPv4 10.20.193.14:37918 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.869794] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.869816] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode8_2, OMAP version: 127 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:02] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.957115] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:02.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:02.957141] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:02.960 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:29:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:1684 (2): Start update from 125 to 126 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:1684 (108): Start update from 125 to 126 (discovery-trial155). 2026-02-18T03:29:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:2068 (108): Update complete (125 -> 126) (discovery-trial155). 2026-02-18T03:29:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:02.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.710032] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.155:0/1683886157, rc 0 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.710128] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.155:0/1683886157 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.155:0/1683886157' 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.720685] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.725119] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:02.725140] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (125 -> 126) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:02] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:02.984 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:02.984 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:02.984 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage31 2026-02-18T03:29:02.984 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode8 --rbd-pool mypool --rbd-image myimage31 --load-balancing-group 4 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO state.py:1684 (141): Start update from 125 to 126 (discovery-trial086). 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO state.py:2068 (141): Update complete (125 -> 126) (discovery-trial086). 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO state.py:1684 (2): Start update from 125 to 126 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.705355] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.86:0/3062243159, rc 0 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.708635] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.86:0/3062243159 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.86:0/3062243159' 2026-02-18T03:29:03.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.719860] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.724562] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:02.724588] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (125 -> 126) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.006 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.177:0/2499286333' 2026-02-18T03:29:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.723903] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:29:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.728451] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:29:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:02.728474] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] INFO state.py:2068 (2): Update complete (125 -> 126) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:02] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: pgmap v177: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.3 KiB/s wr, 1.05k op/s 2026-02-18T03:29:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2193808773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: pgmap v177: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.3 KiB/s wr, 1.05k op/s 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/2193808773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:03.395 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: pgmap v177: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.3 KiB/s wr, 1.05k op/s 2026-02-18T03:29:03.395 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:03.395 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2193808773' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:03.395 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:03.396 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:03.396 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:03.396 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO state.py:1684 (84): Start update from 126 to 127 (discovery-trial034). 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO state.py:2068 (84): Update complete (126 -> 127) (discovery-trial034). 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:43792 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage31, no need to remove 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:03.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:43792 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.565610] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.34:0/647734345, rc 0 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.565681] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.34:0/647734345 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.34:0/647734345' 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.575662] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: , client address: IPv4 10.20.193.14:43792 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.580447] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.580466] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode8_3, OMAP version: 128 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:03] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.674165] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:03.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:03.674199] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:03.678 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:29:03.700 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:03.700 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:03.700 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage32 2026-02-18T03:29:03.700 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode8 --rbd-pool mypool --rbd-image myimage32 --load-balancing-group 1 2026-02-18T03:29:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO state.py:1684 (129): Start update from 126 to 127 (discovery-trial177). 2026-02-18T03:29:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO state.py:2068 (129): Update complete (126 -> 127) (discovery-trial177). 2026-02-18T03:29:03.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO state.py:1684 (2): Start update from 126 to 127 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:03.416903] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.177:0/3351881703, rc 0 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:03.416973] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.177:0/3351881703 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.177:0/3351881703' 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:03.427082] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:03.431682] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:03.431704] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] INFO state.py:2068 (2): Update complete (126 -> 127) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:03.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:03] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO state.py:1684 (108): Start update from 126 to 127 (discovery-trial155). 2026-02-18T03:29:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO state.py:2068 (108): Update complete (126 -> 127) (discovery-trial155). 2026-02-18T03:29:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO state.py:1684 (2): Start update from 126 to 127 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:03.421127] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.155:0/58660507, rc 0 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:03.421207] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.155:0/58660507 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.155:0/58660507' 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:03.430672] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:03.435404] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:03.435428] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] INFO state.py:2068 (2): Update complete (126 -> 127) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:03 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:03] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.737 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO state.py:1684 (141): Start update from 126 to 127 (discovery-trial086). 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO state.py:2068 (141): Update complete (126 -> 127) (discovery-trial086). 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO state.py:1684 (2): Start update from 126 to 127 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:03.420445] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.86:0/1997275800, rc 0 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:03.420594] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.86:0/1997275800 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.86:0/1997275800' 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:03.429631] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:03.437831] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:03.437860] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] INFO state.py:2068 (2): Update complete (126 -> 127) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:03] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 127 to 128 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:04.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:04.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:04.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:1684 (141): Start update from 127 to 128 (discovery-trial086). 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:2068 (141): Update complete (127 -> 128) (discovery-trial086). 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.130203] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.86:0/1561286325, rc 0 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.130622] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.86:0/1561286325 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.86:0/1561286325' 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.141200] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.145820] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.145840] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (127 -> 128) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.395 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:1684 (84): Start update from 127 to 128 (discovery-trial034). 2026-02-18T03:29:04.395 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:2068 (84): Update complete (127 -> 128) (discovery-trial034). 2026-02-18T03:29:04.395 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:34032 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage32, no need to remove 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:34032 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.282476] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.34:0/2620370271, rc 0 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.282560] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.34:0/2620370271 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.34:0/2620370271' 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.292616] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: , client address: IPv4 10.20.193.14:34032 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.297346] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.297367] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode8_4, OMAP version: 129 2026-02-18T03:29:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.394657] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.394682] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:04.398 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode8: Successful 2026-02-18T03:29:04.420 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:04.421 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:04.421 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:04.421 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:04.421 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:04.422 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage33 2026-02-18T03:29:04.422 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode9 --rbd-pool mypool --rbd-image myimage33 --load-balancing-group 2 2026-02-18T03:29:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 127 to 128 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:04.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:1684 (129): Start update from 127 to 128 (discovery-trial177). 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:2068 (129): Update complete (127 -> 128) (discovery-trial177). 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.127589] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.177:0/293812606, rc 0 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.127642] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.177:0/293812606 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.177:0/293812606' 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.138252] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.142820] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.142840] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (127 -> 128) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.465 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:04Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 127 to 128 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:1684 (108): Start update from 127 to 128 (discovery-trial155). 2026-02-18T03:29:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:2068 (108): Update complete (127 -> 128) (discovery-trial155). 2026-02-18T03:29:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.131026] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.155:0/1754246419, rc 0 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.131095] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.155:0/1754246419 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.155:0/1754246419' 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.142188] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.146771] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.146792] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (127 -> 128) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:04.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.096 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-mon[21825]: pgmap v178: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.09k op/s 2026-02-18T03:29:05.096 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1599570593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:05.096 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:1684 (84): Start update from 128 to 129 (discovery-trial034). 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:2068 (84): Update complete (128 -> 129) (discovery-trial034). 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:51814 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage33, no need to remove 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:51814 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:04.995624] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: , client address: IPv4 10.20.193.14:51814 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.000067] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:29:05.097 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.000090] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:05.098 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode9_1, OMAP version: 130 2026-02-18T03:29:05.098 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.098 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.098 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.095572] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:05.098 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.095602] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:05.100 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:29:05.122 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:05.122 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:05.122 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage34 2026-02-18T03:29:05.122 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode9 --rbd-pool mypool --rbd-image myimage34 --load-balancing-group 3 2026-02-18T03:29:05.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-mon[24100]: pgmap v178: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.09k op/s 2026-02-18T03:29:05.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1599570593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 128 to 129 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:1684 (141): Start update from 128 to 129 (discovery-trial086). 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:2068 (141): Update complete (128 -> 129) (discovery-trial086). 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.837671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.86:0/2015678350, rc 0 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.837747] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.86:0/2015678350 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.86:0/2015678350' 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.846341] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.851452] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:04.851473] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (128 -> 129) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.161 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:05.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:1684 (129): Start update from 128 to 129 (discovery-trial177). 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:2068 (129): Update complete (128 -> 129) (discovery-trial177). 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 128 to 129 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.846834] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.177:0/2783624947, rc 0 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.846887] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.177:0/2783624947 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.177:0/2783624947' 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.857136] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:29:05.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.861714] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:29:05.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:04.861734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:05.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (128 -> 129) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:05.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-mon[24719]: pgmap v178: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.09k op/s 2026-02-18T03:29:05.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1599570593' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:05.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:1684 (2): Start update from 128 to 129 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:1684 (108): Start update from 128 to 129 (discovery-trial155). 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:2068 (108): Update complete (128 -> 129) (discovery-trial155). 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.846623] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.155:0/983070006, rc 0 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.846688] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.155:0/983070006 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.155:0/983070006' 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.855972] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.860790] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:04.860814] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:05.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:04] INFO state.py:2068 (2): Update complete (128 -> 129) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:05.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO state.py:1684 (84): Start update from 129 to 130 (discovery-trial034). 2026-02-18T03:29:05.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO state.py:2068 (84): Update complete (129 -> 130) (discovery-trial034). 2026-02-18T03:29:05.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:55532 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage34, no need to remove 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:55532 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.684478] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: , client address: IPv4 10.20.193.14:55532 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.688994] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.689018] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode9_2, OMAP version: 131 2026-02-18T03:29:05.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:05] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.781653] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:05.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:05.781682] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:05.784 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:29:05.811 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:05.811 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:05.812 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage35 2026-02-18T03:29:05.812 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode9 --rbd-pool mypool --rbd-image myimage35 --load-balancing-group 4 2026-02-18T03:29:05.846 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO state.py:1684 (141): Start update from 129 to 130 (discovery-trial086). 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO state.py:2068 (141): Update complete (129 -> 130) (discovery-trial086). 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO state.py:1684 (2): Start update from 129 to 130 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:05.548425] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:29:05.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:05.552918] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:29:05.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:05.552941] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:05.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] INFO state.py:2068 (2): Update complete (129 -> 130) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:05.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO state.py:1684 (129): Start update from 129 to 130 (discovery-trial177). 2026-02-18T03:29:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO state.py:2068 (129): Update complete (129 -> 130) (discovery-trial177). 2026-02-18T03:29:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO state.py:1684 (2): Start update from 129 to 130 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:05.546217] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:05.550767] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:05.550787] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] INFO state.py:2068 (2): Update complete (129 -> 130) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:05] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO state.py:1684 (2): Start update from 129 to 130 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO state.py:1684 (108): Start update from 129 to 130 (discovery-trial155). 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO state.py:2068 (108): Update complete (129 -> 130) (discovery-trial155). 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:05.549724] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:05.554358] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:05.554382] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] INFO state.py:2068 (2): Update complete (129 -> 130) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:05] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.462 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:1684 (129): Start update from 130 to 131 (discovery-trial177). 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:2068 (129): Update complete (130 -> 131) (discovery-trial177). 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 130 to 131 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.239604] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.244232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.244251] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (130 -> 131) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 130 to 131 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:1684 (108): Start update from 130 to 131 (discovery-trial155). 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:2068 (108): Update complete (130 -> 131) (discovery-trial155). 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.242701] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.247097] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.247120] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (130 -> 131) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.483 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:06.483 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:06.483 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage36 2026-02-18T03:29:06.483 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode9 --rbd-pool mypool --rbd-image myimage36 --load-balancing-group 1 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:1684 (84): Start update from 130 to 131 (discovery-trial034). 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:2068 (84): Update complete (130 -> 131) (discovery-trial034). 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:59568 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage35, no need to remove 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:59568 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:06.355647] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: , client address: IPv4 10.20.193.14:59568 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:06.360110] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:06.360137] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode9_3, OMAP version: 132 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:06.458846] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:06.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:06.458875] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:06.522 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:1684 (141): Start update from 130 to 131 (discovery-trial086). 2026-02-18T03:29:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:2068 (141): Update complete (130 -> 131) (discovery-trial086). 2026-02-18T03:29:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 130 to 131 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.237622] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.264219] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.264260] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (130 -> 131) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.173 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-mon[21825]: pgmap v179: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.7 KiB/s wr, 1.30k op/s 2026-02-18T03:29:07.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:1684 (84): Start update from 131 to 132 (discovery-trial034). 2026-02-18T03:29:07.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:2068 (84): Update complete (131 -> 132) (discovery-trial034). 2026-02-18T03:29:07.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:50566 2026-02-18T03:29:07.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage36, no need to remove 2026-02-18T03:29:07.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:06 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:06] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:50566 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.065667] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: , client address: IPv4 10.20.193.14:50566 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.070137] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.070159] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode9_4, OMAP version: 133 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.175 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.172211] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:07.175 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.172240] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:07.176 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode9: Successful 2026-02-18T03:29:07.196 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:07.196 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:07.196 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:07.196 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:07.197 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:07.197 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage37 2026-02-18T03:29:07.197 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode10 --rbd-pool mypool --rbd-image myimage37 --load-balancing-group 2 2026-02-18T03:29:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 131 to 132 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:1684 (129): Start update from 131 to 132 (discovery-trial177). 2026-02-18T03:29:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:2068 (129): Update complete (131 -> 132) (discovery-trial177). 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.902185] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.906640] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:06.906660] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (131 -> 132) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-mon[24719]: pgmap v179: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.7 KiB/s wr, 1.30k op/s 2026-02-18T03:29:07.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:1684 (108): Start update from 131 to 132 (discovery-trial155). 2026-02-18T03:29:07.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:2068 (108): Update complete (131 -> 132) (discovery-trial155). 2026-02-18T03:29:07.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 131 to 132 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:07.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.912121] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.916586] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:06.916609] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (131 -> 132) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.235 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-mon[24100]: pgmap v179: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.7 KiB/s wr, 1.30k op/s 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:1684 (141): Start update from 131 to 132 (discovery-trial086). 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:2068 (141): Update complete (131 -> 132) (discovery-trial086). 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:1684 (2): Start update from 131 to 132 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.908540] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.912950] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:06.912977] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:06] INFO state.py:2068 (2): Update complete (131 -> 132) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.834 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:29:07.853 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:07.853 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:07.853 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage38 2026-02-18T03:29:07.853 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode10 --rbd-pool mypool --rbd-image myimage38 --load-balancing-group 3 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO state.py:1684 (141): Start update from 132 to 133 (discovery-trial086). 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO state.py:2068 (141): Update complete (132 -> 133) (discovery-trial086). 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO state.py:1684 (2): Start update from 132 to 133 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:07.622034] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:07.626459] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:07.626483] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] INFO state.py:2068 (2): Update complete (132 -> 133) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.893 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO state.py:1684 (2): Start update from 132 to 133 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO state.py:1684 (129): Start update from 132 to 133 (discovery-trial177). 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO state.py:2068 (129): Update complete (132 -> 133) (discovery-trial177). 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:07.616175] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:07.620551] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:07.620570] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] INFO state.py:2068 (2): Update complete (132 -> 133) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:07] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO state.py:1684 (108): Start update from 132 to 133 (discovery-trial155). 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO state.py:2068 (108): Update complete (132 -> 133) (discovery-trial155). 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO state.py:1684 (2): Start update from 132 to 133 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:07.625088] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:07.629524] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:07.629549] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] INFO state.py:2068 (2): Update complete (132 -> 133) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:07.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO state.py:1684 (84): Start update from 132 to 133 (discovery-trial034). 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO state.py:2068 (84): Update complete (132 -> 133) (discovery-trial034). 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:40952 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage37, no need to remove 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:08.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:40952 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.740786] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: , client address: IPv4 10.20.193.14:40952 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.745322] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.745347] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode10_1, OMAP version: 134 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:07] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.831259] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:08.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:07.831294] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:08.516 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:29:08.536 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:08.536 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:08.536 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage39 2026-02-18T03:29:08.536 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode10 --rbd-pool mypool --rbd-image myimage39 --load-balancing-group 4 2026-02-18T03:29:08.575 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:1684 (141): Start update from 133 to 134 (discovery-trial086). 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:2068 (141): Update complete (133 -> 134) (discovery-trial086). 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 133 to 134 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.291630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.310862] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.310894] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:2068 (2): Update complete (133 -> 134) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 133 to 134 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:1684 (129): Start update from 133 to 134 (discovery-trial177). 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:2068 (129): Update complete (133 -> 134) (discovery-trial177). 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.289272] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.293801] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.293821] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:2068 (2): Update complete (133 -> 134) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:08.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:1684 (108): Start update from 133 to 134 (discovery-trial155). 2026-02-18T03:29:08.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:2068 (108): Update complete (133 -> 134) (discovery-trial155). 2026-02-18T03:29:08.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 133 to 134 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:08.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.294052] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.298434] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.298462] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:2068 (2): Update complete (133 -> 134) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:1684 (84): Start update from 133 to 134 (discovery-trial034). 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:2068 (84): Update complete (133 -> 134) (discovery-trial034). 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:33686 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage38, no need to remove 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:08.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:33686 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:08.416411] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: , client address: IPv4 10.20.193.14:33686 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:08.420796] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:08.420824] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode10_2, OMAP version: 135 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:08.512462] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:08.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:08.512495] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:09.203 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-mon[21825]: pgmap v180: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.5 KiB/s wr, 1.19k op/s 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:1684 (84): Start update from 134 to 135 (discovery-trial034). 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:08 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:08] INFO state.py:2068 (84): Update complete (134 -> 135) (discovery-trial034). 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:59156 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage39, no need to remove 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:59156 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.105466] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: , client address: IPv4 10.20.193.14:59156 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.109915] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.109940] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode10_3, OMAP version: 136 2026-02-18T03:29:09.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.202962] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:09.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.202993] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:09.206 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:1684 (129): Start update from 134 to 135 (discovery-trial177). 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:2068 (129): Update complete (134 -> 135) (discovery-trial177). 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 134 to 135 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.975607] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.980255] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:08.980275] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (134 -> 135) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-mon[24719]: pgmap v180: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.5 KiB/s wr, 1.19k op/s 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:1684 (108): Start update from 134 to 135 (discovery-trial155). 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:2068 (108): Update complete (134 -> 135) (discovery-trial155). 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 134 to 135 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.972275] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.976700] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:08.976725] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (134 -> 135) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.228 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:09.228 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:09.228 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage40 2026-02-18T03:29:09.228 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode10 --rbd-pool mypool --rbd-image myimage40 --load-balancing-group 1 2026-02-18T03:29:09.271 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:09.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-mon[24100]: pgmap v180: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.5 KiB/s wr, 1.19k op/s 2026-02-18T03:29:09.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:1684 (2): Start update from 134 to 135 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:1684 (141): Start update from 134 to 135 (discovery-trial086). 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO state.py:2068 (141): Update complete (134 -> 135) (discovery-trial086). 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.972904] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:08] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.977389] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:08.977413] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (134 -> 135) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:1684 (84): Start update from 135 to 136 (discovery-trial034). 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:2068 (84): Update complete (135 -> 136) (discovery-trial034). 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:49258 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage40, no need to remove 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:49258 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.791981] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: , client address: IPv4 10.20.193.14:49258 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.796567] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.796590] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode10_4, OMAP version: 137 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:09] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.893589] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:09.894 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:09 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:09.893620] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:09.897 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode10: Successful 2026-02-18T03:29:09.924 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:09.924 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:09.924 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:09.924 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:09.925 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:09.925 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage41 2026-02-18T03:29:09.925 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode11 --rbd-pool mypool --rbd-image myimage41 --load-balancing-group 2 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO state.py:1684 (129): Start update from 135 to 136 (discovery-trial177). 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO state.py:2068 (129): Update complete (135 -> 136) (discovery-trial177). 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO state.py:1684 (2): Start update from 135 to 136 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:09.656731] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:09.661170] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:09.661191] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (135 -> 136) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:09] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.964 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO state.py:1684 (108): Start update from 135 to 136 (discovery-trial155). 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO state.py:2068 (108): Update complete (135 -> 136) (discovery-trial155). 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO state.py:1684 (2): Start update from 135 to 136 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:09.661795] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:09.666379] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:09.666407] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (135 -> 136) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:09.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO state.py:1684 (2): Start update from 135 to 136 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO state.py:1684 (141): Start update from 135 to 136 (discovery-trial086). 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO state.py:2068 (141): Update complete (135 -> 136) (discovery-trial086). 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:09.658828] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:09.663270] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:09.663291] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] INFO state.py:2068 (2): Update complete (135 -> 136) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.026 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:09] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3694838617' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2116974581' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.318 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3694838617' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.318 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2116974581' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.320 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3694838617' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.321 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/2116974581' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:10.610 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO state.py:1684 (84): Start update from 136 to 137 (discovery-trial034). 2026-02-18T03:29:10.610 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO state.py:2068 (84): Update complete (136 -> 137) (discovery-trial034). 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:50102 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage41, no need to remove 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:50102 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:10.514861] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: , client address: IPv4 10.20.193.14:50102 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:10.519315] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:10.519341] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:10.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode11_1, OMAP version: 138 2026-02-18T03:29:10.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:10.609624] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:10.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:10.609652] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:10.613 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO state.py:1684 (141): Start update from 136 to 137 (discovery-trial086). 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO state.py:2068 (141): Update complete (136 -> 137) (discovery-trial086). 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO state.py:1684 (2): Start update from 136 to 137 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:10.348518] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:29:10.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:10.352979] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:29:10.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:10.353004] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:10.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] INFO state.py:2068 (2): Update complete (136 -> 137) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:10.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.634 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:10.634 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:10.634 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage42 2026-02-18T03:29:10.634 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode11 --rbd-pool mypool --rbd-image myimage42 --load-balancing-group 3 2026-02-18T03:29:10.678 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:10.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO state.py:1684 (2): Start update from 136 to 137 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:10.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:10.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO state.py:1684 (129): Start update from 136 to 137 (discovery-trial177). 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO state.py:2068 (129): Update complete (136 -> 137) (discovery-trial177). 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:10.341222] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:10.345661] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:10.345681] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] INFO state.py:2068 (2): Update complete (136 -> 137) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:10] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO state.py:1684 (108): Start update from 136 to 137 (discovery-trial155). 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO state.py:2068 (108): Update complete (136 -> 137) (discovery-trial155). 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO state.py:1684 (2): Start update from 136 to 137 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:10.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:10.346872] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:10.351298] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:10.351326] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] INFO state.py:2068 (2): Update complete (136 -> 137) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:10.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:10] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.321 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-mon[21825]: pgmap v181: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.07k op/s 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:1684 (84): Start update from 137 to 138 (discovery-trial034). 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:2068 (84): Update complete (137 -> 138) (discovery-trial034). 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:37450 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage42, no need to remove 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:11.321 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:37450 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.214932] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: , client address: IPv4 10.20.193.14:37450 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.219370] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.219397] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode11_2, OMAP version: 139 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.321205] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:11.322 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.321234] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:11.325 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:29:11.346 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:11.347 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:11.347 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage43 2026-02-18T03:29:11.347 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode11 --rbd-pool mypool --rbd-image myimage43 --load-balancing-group 4 2026-02-18T03:29:11.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-mon[24100]: pgmap v181: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.07k op/s 2026-02-18T03:29:11.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:1684 (141): Start update from 137 to 138 (discovery-trial086). 2026-02-18T03:29:11.372 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:2068 (141): Update complete (137 -> 138) (discovery-trial086). 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 137 to 138 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.066282] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.070900] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.070927] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (137 -> 138) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.386 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 137 to 138 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:1684 (129): Start update from 137 to 138 (discovery-trial177). 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:2068 (129): Update complete (137 -> 138) (discovery-trial177). 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.058460] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.063365] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.063385] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (137 -> 138) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-mon[24719]: pgmap v181: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.2 KiB/s wr, 1.07k op/s 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:1684 (108): Start update from 137 to 138 (discovery-trial155). 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 137 to 138 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:2068 (108): Update complete (137 -> 138) (discovery-trial155). 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.071630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.076043] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.076073] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (137 -> 138) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:11.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:1684 (84): Start update from 138 to 139 (discovery-trial034). 2026-02-18T03:29:12.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:2068 (84): Update complete (138 -> 139) (discovery-trial034). 2026-02-18T03:29:12.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:42432 2026-02-18T03:29:12.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage43, no need to remove 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:42432 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.910315] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: , client address: IPv4 10.20.193.14:42432 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.914767] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:11.914791] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode11_3, OMAP version: 140 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:11] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.005459] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:12.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.005488] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:12.012 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:29:12.033 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:12.033 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:12.033 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage44 2026-02-18T03:29:12.033 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode11 --rbd-pool mypool --rbd-image myimage44 --load-balancing-group 1 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 138 to 139 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:1684 (108): Start update from 138 to 139 (discovery-trial155). 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:2068 (108): Update complete (138 -> 139) (discovery-trial155). 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.772343] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:29:12.034 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.776737] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:11.776765] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (138 -> 139) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:1684 (141): Start update from 138 to 139 (discovery-trial086). 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:2068 (141): Update complete (138 -> 139) (discovery-trial086). 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 138 to 139 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.768153] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.772593] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:11.772618] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (138 -> 139) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.061 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:12.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:1684 (129): Start update from 138 to 139 (discovery-trial177). 2026-02-18T03:29:12.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:2068 (129): Update complete (138 -> 139) (discovery-trial177). 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:1684 (2): Start update from 138 to 139 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.767581] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.772327] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:11.772349] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] INFO state.py:2068 (2): Update complete (138 -> 139) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:11] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1311428908' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/1311428908' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:12.436 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1311428908' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:12.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO state.py:1684 (2): Start update from 139 to 140 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:12.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO state.py:1684 (129): Start update from 139 to 140 (discovery-trial177). 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO state.py:2068 (129): Update complete (139 -> 140) (discovery-trial177). 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:12.464253] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:12.468665] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:12.468685] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] INFO state.py:2068 (2): Update complete (139 -> 140) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:12] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO state.py:1684 (108): Start update from 139 to 140 (discovery-trial155). 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO state.py:2068 (108): Update complete (139 -> 140) (discovery-trial155). 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO state.py:1684 (2): Start update from 139 to 140 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:12.466269] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:12.470733] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:12.470760] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] INFO state.py:2068 (2): Update complete (139 -> 140) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO state.py:1684 (84): Start update from 139 to 140 (discovery-trial034). 2026-02-18T03:29:12.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO state.py:2068 (84): Update complete (139 -> 140) (discovery-trial034). 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:45366 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage44, no need to remove 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:45366 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.621069] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: , client address: IPv4 10.20.193.14:45366 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.639310] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.639336] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:12.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode11_4, OMAP version: 141 2026-02-18T03:29:12.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:12] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.736096] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:12.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:12 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:12.736122] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:12.740 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode11: Successful 2026-02-18T03:29:12.761 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:12.761 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:12.761 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:12.761 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:12.762 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:12.762 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage45 2026-02-18T03:29:12.762 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode12 --rbd-pool mypool --rbd-image myimage45 --load-balancing-group 2 2026-02-18T03:29:12.801 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:12Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO state.py:1684 (141): Start update from 139 to 140 (discovery-trial086). 2026-02-18T03:29:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO state.py:2068 (141): Update complete (139 -> 140) (discovery-trial086). 2026-02-18T03:29:12.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO state.py:1684 (2): Start update from 139 to 140 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:12.460818] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:12.465243] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:12.465270] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] INFO state.py:2068 (2): Update complete (139 -> 140) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:12.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:12] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.303 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-mon[21825]: pgmap v182: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.8 KiB/s wr, 1.30k op/s 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:1684 (84): Start update from 140 to 141 (discovery-trial034). 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:2068 (84): Update complete (140 -> 141) (discovery-trial034). 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:54404 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage45, no need to remove 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:13.304 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:13.305 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:54404 2026-02-18T03:29:13.339 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-mon[24100]: pgmap v182: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.8 KiB/s wr, 1.30k op/s 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 140 to 141 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:1684 (141): Start update from 140 to 141 (discovery-trial086). 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:2068 (141): Update complete (140 -> 141) (discovery-trial086). 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.182379] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.186799] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:29:13.340 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.186823] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:13.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (140 -> 141) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:13.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.341 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-mon[24719]: pgmap v182: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.8 KiB/s wr, 1.30k op/s 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:1684 (108): Start update from 140 to 141 (discovery-trial155). 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:2068 (108): Update complete (140 -> 141) (discovery-trial155). 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 140 to 141 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:13.342 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.187954] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:13.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:29:13.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.192429] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:29:13.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.192455] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:13.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (140 -> 141) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:13.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.416 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:29:13.438 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:13.438 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:13.438 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage46 2026-02-18T03:29:13.438 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode12 --rbd-pool mypool --rbd-image myimage46 --load-balancing-group 3 2026-02-18T03:29:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 140 to 141 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:13.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:1684 (129): Start update from 140 to 141 (discovery-trial177). 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:2068 (129): Update complete (140 -> 141) (discovery-trial177). 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.185224] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.189658] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.189680] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (140 -> 141) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.472 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:13.324452] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:13.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: , client address: IPv4 10.20.193.14:54404 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:13.328854] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:13.328881] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode12_1, OMAP version: 142 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:13.412865] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:13.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:13.412902] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:14.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/3752204537' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:14.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:1684 (141): Start update from 141 to 142 (discovery-trial086). 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:2068 (141): Update complete (141 -> 142) (discovery-trial086). 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 141 to 142 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.875590] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.880050] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:13.880072] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (141 -> 142) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.133 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3752204537' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:14.134 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:1684 (84): Start update from 141 to 142 (discovery-trial034). 2026-02-18T03:29:14.134 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:2068 (84): Update complete (141 -> 142) (discovery-trial034). 2026-02-18T03:29:14.134 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:35904 2026-02-18T03:29:14.134 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage46, no need to remove 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:13] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:35904 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.031077] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: , client address: IPv4 10.20.193.14:35904 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.040332] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.040364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode12_2, OMAP version: 143 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.133436] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:14.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.133471] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:14.137 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:29:14.157 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:14.157 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:14.157 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage47 2026-02-18T03:29:14.158 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode12 --rbd-pool mypool --rbd-image myimage47 --load-balancing-group 4 2026-02-18T03:29:14.198 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 141 to 142 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:1684 (129): Start update from 141 to 142 (discovery-trial177). 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:2068 (129): Update complete (141 -> 142) (discovery-trial177). 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.878212] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.882600] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:13.882619] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (141 -> 142) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3752204537' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:1684 (108): Start update from 141 to 142 (discovery-trial155). 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:2068 (108): Update complete (141 -> 142) (discovery-trial155). 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:1684 (2): Start update from 141 to 142 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.881145] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.885720] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:13.885745] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:13] INFO state.py:2068 (2): Update complete (141 -> 142) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO state.py:1684 (84): Start update from 142 to 143 (discovery-trial034). 2026-02-18T03:29:14.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO state.py:2068 (84): Update complete (142 -> 143) (discovery-trial034). 2026-02-18T03:29:14.825 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:44258 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage47, no need to remove 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:44258 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.718804] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: , client address: IPv4 10.20.193.14:44258 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.723282] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.723305] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode12_3, OMAP version: 144 2026-02-18T03:29:14.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:14] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.824665] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:14.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:14.824701] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:14.828 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:29:14.850 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:14.850 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:14.851 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage48 2026-02-18T03:29:14.851 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode12 --rbd-pool mypool --rbd-image myimage48 --load-balancing-group 1 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO state.py:1684 (141): Start update from 142 to 143 (discovery-trial086). 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO state.py:2068 (141): Update complete (142 -> 143) (discovery-trial086). 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO state.py:1684 (2): Start update from 142 to 143 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:14.589224] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:29:14.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:14.593630] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:29:14.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:14.593657] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:14.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] INFO state.py:2068 (2): Update complete (142 -> 143) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:14.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.889 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:14Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO state.py:1684 (129): Start update from 142 to 143 (discovery-trial177). 2026-02-18T03:29:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO state.py:2068 (129): Update complete (142 -> 143) (discovery-trial177). 2026-02-18T03:29:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO state.py:1684 (2): Start update from 142 to 143 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:14.592456] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:14.597013] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:14.597034] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] INFO state.py:2068 (2): Update complete (142 -> 143) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:14] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO state.py:1684 (108): Start update from 142 to 143 (discovery-trial155). 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO state.py:2068 (108): Update complete (142 -> 143) (discovery-trial155). 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO state.py:1684 (2): Start update from 142 to 143 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:14.591766] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:14.596177] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:14.596205] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] INFO state.py:2068 (2): Update complete (142 -> 143) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:14] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.253 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-mon[21825]: pgmap v183: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.2 KiB/s wr, 1.21k op/s 2026-02-18T03:29:15.335 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-mon[24100]: pgmap v183: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.2 KiB/s wr, 1.21k op/s 2026-02-18T03:29:15.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:1684 (141): Start update from 143 to 144 (discovery-trial086). 2026-02-18T03:29:15.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:2068 (141): Update complete (143 -> 144) (discovery-trial086). 2026-02-18T03:29:15.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 143 to 144 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:15.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.274687] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.279183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.279208] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:15.336 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:2068 (2): Update complete (143 -> 144) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:15.337 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-mon[24719]: pgmap v183: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.2 KiB/s wr, 1.21k op/s 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:1684 (108): Start update from 143 to 144 (discovery-trial155). 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:2068 (108): Update complete (143 -> 144) (discovery-trial155). 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 143 to 144 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.277211] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.281630] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:29:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.281655] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:2068 (2): Update complete (143 -> 144) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:15.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:1684 (84): Start update from 143 to 144 (discovery-trial034). 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:2068 (84): Update complete (143 -> 144) (discovery-trial034). 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:39914 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage48, no need to remove 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:39914 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:15.430627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: , client address: IPv4 10.20.193.14:39914 2026-02-18T03:29:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:15.435107] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:29:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:15.435132] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode12_4, OMAP version: 145 2026-02-18T03:29:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.536 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode12: Successful 2026-02-18T03:29:15.557 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:15.557 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:15.557 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:15.557 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:15.558 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:15.558 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage49 2026-02-18T03:29:15.559 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode13 --rbd-pool mypool --rbd-image myimage49 --load-balancing-group 2 2026-02-18T03:29:15.598 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:15.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 143 to 144 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:15.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:15.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:15.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:1684 (129): Start update from 143 to 144 (discovery-trial177). 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:2068 (129): Update complete (143 -> 144) (discovery-trial177). 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.271084] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.275449] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.275471] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:2068 (2): Update complete (143 -> 144) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:15.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:15.531451] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:15.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:15.531478] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:15.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:1684 (84): Start update from 144 to 145 (discovery-trial034). 2026-02-18T03:29:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:1684 (129): Start update from 144 to 145 (discovery-trial177). 2026-02-18T03:29:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:2068 (129): Update complete (144 -> 145) (discovery-trial177). 2026-02-18T03:29:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 144 to 145 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.988803] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.993201] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:15.993222] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (144 -> 145) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:1684 (108): Start update from 144 to 145 (discovery-trial155). 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 144 to 145 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO state.py:2068 (108): Update complete (144 -> 145) (discovery-trial155). 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:16.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.990651] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.995060] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:15.995090] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (144 -> 145) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:15] INFO state.py:2068 (84): Update complete (144 -> 145) (discovery-trial034). 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:48712 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage49, no need to remove 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:48712 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.136842] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: , client address: IPv4 10.20.193.14:48712 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.141383] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.141413] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode13_1, OMAP version: 146 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.235444] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:16.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.235489] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:16.240 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:29:16.260 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:16.261 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:16.261 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage50 2026-02-18T03:29:16.261 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode13 --rbd-pool mypool --rbd-image myimage50 --load-balancing-group 3 2026-02-18T03:29:16.295 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:1684 (141): Start update from 144 to 145 (discovery-trial086). 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:2068 (141): Update complete (144 -> 145) (discovery-trial086). 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO state.py:1684 (2): Start update from 144 to 145 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.984392] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:15] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.989040] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:15.989065] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (144 -> 145) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:1684 (84): Start update from 145 to 146 (discovery-trial034). 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:2068 (84): Update complete (145 -> 146) (discovery-trial034). 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:57868 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage50, no need to remove 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:57868 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.839074] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: , client address: IPv4 10.20.193.14:57868 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.860327] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.860358] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode13_2, OMAP version: 147 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:16] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.955988] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:16.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:16 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:16.956017] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:16.960 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO state.py:1684 (129): Start update from 145 to 146 (discovery-trial177). 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO state.py:2068 (129): Update complete (145 -> 146) (discovery-trial177). 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO state.py:1684 (2): Start update from 145 to 146 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:16.691120] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:16.695981] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:16.696002] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (145 -> 146) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO state.py:1684 (2): Start update from 145 to 146 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO state.py:1684 (108): Start update from 145 to 146 (discovery-trial155). 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO state.py:2068 (108): Update complete (145 -> 146) (discovery-trial155). 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:16.696047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:16.700612] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:16.700638] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (145 -> 146) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:16.981 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:16.981 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:16.981 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage51 2026-02-18T03:29:16.981 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode13 --rbd-pool mypool --rbd-image myimage51 --load-balancing-group 4 2026-02-18T03:29:17.032 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:17Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO state.py:1684 (141): Start update from 145 to 146 (discovery-trial086). 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO state.py:2068 (141): Update complete (145 -> 146) (discovery-trial086). 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO state.py:1684 (2): Start update from 145 to 146 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:16.690413] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:16.694947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:16.694980] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] INFO state.py:2068 (2): Update complete (145 -> 146) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.048 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:16] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-mon[21825]: pgmap v184: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.3 KiB/s wr, 1.23k op/s 2026-02-18T03:29:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3739666039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1433620118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-mon[24100]: pgmap v184: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.3 KiB/s wr, 1.23k op/s 2026-02-18T03:29:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3739666039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/1433620118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.386 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-mon[24719]: pgmap v184: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.3 KiB/s wr, 1.23k op/s 2026-02-18T03:29:17.386 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3739666039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.386 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1433620118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:17.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO state.py:1684 (84): Start update from 146 to 147 (discovery-trial034). 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO state.py:2068 (84): Update complete (146 -> 147) (discovery-trial034). 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:60622 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage51, no need to remove 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:60622 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:17.530078] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: , client address: IPv4 10.20.193.14:60622 2026-02-18T03:29:17.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:17.549295] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:17.549326] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode13_3, OMAP version: 148 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:17] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:17.638812] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:17.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:17 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:17.638839] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:17.643 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:29:17.665 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:17.665 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:17.665 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage52 2026-02-18T03:29:17.665 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode13 --rbd-pool mypool --rbd-image myimage52 --load-balancing-group 1 2026-02-18T03:29:17.704 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:17Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:17.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO state.py:1684 (129): Start update from 146 to 147 (discovery-trial177). 2026-02-18T03:29:17.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO state.py:2068 (129): Update complete (146 -> 147) (discovery-trial177). 2026-02-18T03:29:17.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO state.py:1684 (2): Start update from 146 to 147 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:17.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:17.412112] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:17.416647] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:17.416669] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] INFO state.py:2068 (2): Update complete (146 -> 147) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:17 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO state.py:1684 (108): Start update from 146 to 147 (discovery-trial155). 2026-02-18T03:29:17.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO state.py:2068 (108): Update complete (146 -> 147) (discovery-trial155). 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO state.py:1684 (2): Start update from 146 to 147 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:17.413538] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:17.417979] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:17.418024] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] INFO state.py:2068 (2): Update complete (146 -> 147) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:17.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO state.py:1684 (141): Start update from 146 to 147 (discovery-trial086). 2026-02-18T03:29:17.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO state.py:2068 (141): Update complete (146 -> 147) (discovery-trial086). 2026-02-18T03:29:17.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO state.py:1684 (2): Start update from 146 to 147 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:17.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:17.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:17.407857] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:17.412398] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:17.412422] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] INFO state.py:2068 (2): Update complete (146 -> 147) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:17.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:17] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.324 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode13: Successful 2026-02-18T03:29:18.350 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:18.350 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:18.350 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:18.350 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:18.351 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:18.351 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage53 2026-02-18T03:29:18.351 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode14 --rbd-pool mypool --rbd-image myimage53 --load-balancing-group 2 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:1684 (141): Start update from 147 to 148 (discovery-trial086). 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:2068 (141): Update complete (147 -> 148) (discovery-trial086). 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 147 to 148 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.101338] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:18.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:29:18.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.105817] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:29:18.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.105845] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:18.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (147 -> 148) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:18.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.385 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:18.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:1684 (129): Start update from 147 to 148 (discovery-trial177). 2026-02-18T03:29:18.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:2068 (129): Update complete (147 -> 148) (discovery-trial177). 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 147 to 148 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.106487] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.110935] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.110956] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (147 -> 148) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:1684 (108): Start update from 147 to 148 (discovery-trial155). 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:2068 (108): Update complete (147 -> 148) (discovery-trial155). 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 147 to 148 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.104029] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.108522] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.108546] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (147 -> 148) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:1684 (84): Start update from 147 to 148 (discovery-trial034). 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:2068 (84): Update complete (147 -> 148) (discovery-trial034). 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:58552 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage52, no need to remove 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:58552 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.224364] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:18.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: , client address: IPv4 10.20.193.14:58552 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.228933] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.228957] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode13_4, OMAP version: 149 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.320818] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:18.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.320847] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:1684 (84): Start update from 148 to 149 (discovery-trial034). 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:2068 (84): Update complete (148 -> 149) (discovery-trial034). 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:50156 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage53, no need to remove 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:50156 2026-02-18T03:29:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.938866] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: , client address: IPv4 10.20.193.14:50156 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.943357] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:18.943381] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode14_1, OMAP version: 150 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:18 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.045 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:29:19.054 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:1684 (108): Start update from 148 to 149 (discovery-trial155). 2026-02-18T03:29:19.054 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:2068 (108): Update complete (148 -> 149) (discovery-trial155). 2026-02-18T03:29:19.054 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 148 to 149 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.785113] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.789538] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:18.789561] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (148 -> 149) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:18] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:1684 (141): Start update from 148 to 149 (discovery-trial086). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:2068 (141): Update complete (148 -> 149) (discovery-trial086). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 148 to 149 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.779500] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.783912] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:18.783936] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (148 -> 149) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.067 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:19.067 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:19.067 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage54 2026-02-18T03:29:19.067 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode14 --rbd-pool mypool --rbd-image myimage54 --load-balancing-group 3 2026-02-18T03:29:19.106 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:1684 (129): Start update from 148 to 149 (discovery-trial177). 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:2068 (129): Update complete (148 -> 149) (discovery-trial177). 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:1684 (2): Start update from 148 to 149 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.784332] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.803496] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:18.803520] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] INFO state.py:2068 (2): Update complete (148 -> 149) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:18] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-mon[24100]: pgmap v185: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.05k op/s 2026-02-18T03:29:19.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/299311867' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:19.467 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-mon[21825]: pgmap v185: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.05k op/s 2026-02-18T03:29:19.467 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/299311867' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.041849] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.041875] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:19.470 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-mon[24719]: pgmap v185: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.05k op/s 2026-02-18T03:29:19.470 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/299311867' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO state.py:1684 (2): Start update from 149 to 150 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO state.py:1684 (108): Start update from 149 to 150 (discovery-trial155). 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO state.py:2068 (108): Update complete (149 -> 150) (discovery-trial155). 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:19.498141] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:19.502674] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:19.502700] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] INFO state.py:2068 (2): Update complete (149 -> 150) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO state.py:1684 (84): Start update from 149 to 150 (discovery-trial034). 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO state.py:2068 (84): Update complete (149 -> 150) (discovery-trial034). 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:56264 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage54, no need to remove 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:56264 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.636408] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: , client address: IPv4 10.20.193.14:56264 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.640974] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.641000] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode14_2, OMAP version: 151 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:19] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.743616] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:19.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:19 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:19.743648] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:19.747 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:29:19.769 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:19.769 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:19.769 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage55 2026-02-18T03:29:19.769 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode14 --rbd-pool mypool --rbd-image myimage55 --load-balancing-group 4 2026-02-18T03:29:19.814 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:19.872 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO state.py:1684 (141): Start update from 149 to 150 (discovery-trial086). 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO state.py:2068 (141): Update complete (149 -> 150) (discovery-trial086). 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO state.py:1684 (2): Start update from 149 to 150 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:19.494461] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:19.498909] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:19.498936] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] INFO state.py:2068 (2): Update complete (149 -> 150) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO state.py:1684 (2): Start update from 149 to 150 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO state.py:1684 (129): Start update from 149 to 150 (discovery-trial177). 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO state.py:2068 (129): Update complete (149 -> 150) (discovery-trial177). 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:19.492981] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:19.497348] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:19.497370] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] INFO state.py:2068 (2): Update complete (149 -> 150) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:19.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:19] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:1684 (84): Start update from 150 to 151 (discovery-trial034). 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:2068 (84): Update complete (150 -> 151) (discovery-trial034). 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:43244 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage55, no need to remove 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:20.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:43244 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:20.338573] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: , client address: IPv4 10.20.193.14:43244 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:20.343200] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:20.343225] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode14_3, OMAP version: 152 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:20.449103] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:20.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:20.449136] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:20.452 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 150 to 151 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:1684 (129): Start update from 150 to 151 (discovery-trial177). 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:2068 (129): Update complete (150 -> 151) (discovery-trial177). 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.186177] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.190532] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.190554] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (150 -> 151) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.473 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:20.473 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:20.473 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage56 2026-02-18T03:29:20.473 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode14 --rbd-pool mypool --rbd-image myimage56 --load-balancing-group 1 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:1684 (108): Start update from 150 to 151 (discovery-trial155). 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:2068 (108): Update complete (150 -> 151) (discovery-trial155). 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 150 to 151 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.195746] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.200228] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.200255] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (150 -> 151) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.513 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:1684 (141): Start update from 150 to 151 (discovery-trial086). 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:2068 (141): Update complete (150 -> 151) (discovery-trial086). 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 150 to 151 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.191430] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.195853] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.195880] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (150 -> 151) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:20.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-mon[24100]: pgmap v186: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.1 MiB/s rd, 4.7 KiB/s wr, 936 op/s 2026-02-18T03:29:21.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:1684 (141): Start update from 151 to 152 (discovery-trial086). 2026-02-18T03:29:21.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:2068 (141): Update complete (151 -> 152) (discovery-trial086). 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 151 to 152 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.893624] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.907617] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:20.907655] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (151 -> 152) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.198 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-mon[21825]: pgmap v186: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.1 MiB/s rd, 4.7 KiB/s wr, 936 op/s 2026-02-18T03:29:21.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:1684 (84): Start update from 151 to 152 (discovery-trial034). 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO state.py:2068 (84): Update complete (151 -> 152) (discovery-trial034). 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:53876 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage56, no need to remove 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:53876 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.086632] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: , client address: IPv4 10.20.193.14:53876 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.091145] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:29:21.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.091169] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:21.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode14_4, OMAP version: 153 2026-02-18T03:29:21.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.197890] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:21.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.197921] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:21.202 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode14: Successful 2026-02-18T03:29:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 151 to 152 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:1684 (129): Start update from 151 to 152 (discovery-trial177). 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:2068 (129): Update complete (151 -> 152) (discovery-trial177). 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.892022] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.896360] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:20.896382] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (151 -> 152) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.225 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:21.225 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:21.225 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:21.225 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:21.226 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:21.226 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage57 2026-02-18T03:29:21.226 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode15 --rbd-pool mypool --rbd-image myimage57 --load-balancing-group 2 2026-02-18T03:29:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-mon[24719]: pgmap v186: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.1 MiB/s rd, 4.7 KiB/s wr, 936 op/s 2026-02-18T03:29:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:1684 (108): Start update from 151 to 152 (discovery-trial155). 2026-02-18T03:29:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:2068 (108): Update complete (151 -> 152) (discovery-trial155). 2026-02-18T03:29:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:1684 (2): Start update from 151 to 152 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.897039] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.901502] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:20.901527] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:20] INFO state.py:2068 (2): Update complete (151 -> 152) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.265 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO state.py:1684 (141): Start update from 152 to 153 (discovery-trial086). 2026-02-18T03:29:21.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO state.py:2068 (141): Update complete (152 -> 153) (discovery-trial086). 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO state.py:1684 (2): Start update from 152 to 153 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:21.645409] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:21.650093] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:29:21.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:21.650119] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:21.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] INFO state.py:2068 (2): Update complete (152 -> 153) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:21.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:1684 (84): Start update from 152 to 153 (discovery-trial034). 2026-02-18T03:29:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:2068 (84): Update complete (152 -> 153) (discovery-trial034). 2026-02-18T03:29:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:59220 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage57, no need to remove 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:59220 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.792151] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: , client address: IPv4 10.20.193.14:59220 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.796588] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.796610] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode15_1, OMAP version: 154 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:21] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.898 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.895823] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:21.898 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:21.895851] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:21.899 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:29:21.927 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:21.928 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:21.928 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage58 2026-02-18T03:29:21.928 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode15 --rbd-pool mypool --rbd-image myimage58 --load-balancing-group 3 2026-02-18T03:29:21.960 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO state.py:1684 (129): Start update from 152 to 153 (discovery-trial177). 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO state.py:2068 (129): Update complete (152 -> 153) (discovery-trial177). 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO state.py:1684 (2): Start update from 152 to 153 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:21.641486] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:21.645930] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:21.645952] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] INFO state.py:2068 (2): Update complete (152 -> 153) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:21] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO state.py:1684 (108): Start update from 152 to 153 (discovery-trial155). 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO state.py:2068 (108): Update complete (152 -> 153) (discovery-trial155). 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO state.py:1684 (2): Start update from 152 to 153 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:21.646843] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:21.651287] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:21.651312] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] INFO state.py:2068 (2): Update complete (152 -> 153) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:21.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:21] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO state.py:1684 (84): Start update from 153 to 154 (discovery-trial034). 2026-02-18T03:29:22.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO state.py:2068 (84): Update complete (153 -> 154) (discovery-trial034). 2026-02-18T03:29:22.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:40570 2026-02-18T03:29:22.611 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage58, no need to remove 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:40570 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:22.501423] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: , client address: IPv4 10.20.193.14:40570 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:22.505856] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:22.505882] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode15_2, OMAP version: 155 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:22] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.612 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:22.610605] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:22.613 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:22 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:22.610638] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:22.614 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO state.py:1684 (141): Start update from 153 to 154 (discovery-trial086). 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO state.py:2068 (141): Update complete (153 -> 154) (discovery-trial086). 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO state.py:1684 (2): Start update from 153 to 154 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:22.343361] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:22.347902] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:29:22.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:22.347928] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:22.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] INFO state.py:2068 (2): Update complete (153 -> 154) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:22.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.634 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:22.634 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:22.634 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage59 2026-02-18T03:29:22.634 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode15 --rbd-pool mypool --rbd-image myimage59 --load-balancing-group 4 2026-02-18T03:29:22.677 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:22Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO state.py:1684 (2): Start update from 153 to 154 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:22.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO state.py:1684 (129): Start update from 153 to 154 (discovery-trial177). 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO state.py:2068 (129): Update complete (153 -> 154) (discovery-trial177). 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:22.342611] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:22.346997] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:22.347020] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] INFO state.py:2068 (2): Update complete (153 -> 154) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:22 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:22] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO state.py:1684 (108): Start update from 153 to 154 (discovery-trial155). 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO state.py:2068 (108): Update complete (153 -> 154) (discovery-trial155). 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO state.py:1684 (2): Start update from 153 to 154 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:22.344903] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:22.349368] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:22.349393] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] INFO state.py:2068 (2): Update complete (153 -> 154) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:22.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:22] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.318 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-mon[21825]: pgmap v187: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.2 KiB/s wr, 1.12k op/s 2026-02-18T03:29:23.318 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/375841673' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:23.318 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:1684 (84): Start update from 154 to 155 (discovery-trial034). 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:2068 (84): Update complete (154 -> 155) (discovery-trial034). 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:54030 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage59, no need to remove 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:54030 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.207772] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: , client address: IPv4 10.20.193.14:54030 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.212248] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:29:23.319 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.212273] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:23.320 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode15_3, OMAP version: 156 2026-02-18T03:29:23.320 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.320 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.320 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.317506] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:23.320 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.317536] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:23.321 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:29:23.342 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:23.342 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:23.342 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage60 2026-02-18T03:29:23.342 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode15 --rbd-pool mypool --rbd-image myimage60 --load-balancing-group 1 2026-02-18T03:29:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-mon[24100]: pgmap v187: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.2 KiB/s wr, 1.12k op/s 2026-02-18T03:29:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/375841673' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:1684 (141): Start update from 154 to 155 (discovery-trial086). 2026-02-18T03:29:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:2068 (141): Update complete (154 -> 155) (discovery-trial086). 2026-02-18T03:29:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 154 to 155 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.052953] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.057534] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.057561] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (154 -> 155) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.376 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:23.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 154 to 155 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:23.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:23.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:23.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:1684 (129): Start update from 154 to 155 (discovery-trial177). 2026-02-18T03:29:23.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:2068 (129): Update complete (154 -> 155) (discovery-trial177). 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.055380] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.059738] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.059758] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (154 -> 155) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-mon[24719]: pgmap v187: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 6.2 KiB/s wr, 1.12k op/s 2026-02-18T03:29:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/375841673' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:23.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:1684 (108): Start update from 154 to 155 (discovery-trial155). 2026-02-18T03:29:23.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:2068 (108): Update complete (154 -> 155) (discovery-trial155). 2026-02-18T03:29:23.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 154 to 155 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.058331] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.062860] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.062883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (154 -> 155) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:23.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:1684 (84): Start update from 155 to 156 (discovery-trial034). 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:2068 (84): Update complete (155 -> 156) (discovery-trial034). 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:45780 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage60, no need to remove 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:24.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:45780 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.902602] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: , client address: IPv4 10.20.193.14:45780 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.907057] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:23.907081] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode15_4, OMAP version: 157 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:23] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.013361] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.013390] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:24.017 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode15: Successful 2026-02-18T03:29:24.038 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:24.039 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2026-02-18T03:29:24.039 INFO:tasks.workunit.client.0.trial014.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:24.039 INFO:tasks.workunit.client.0.trial014.stderr:++ seq 1 4 2026-02-18T03:29:24.039 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:24.040 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage61 2026-02-18T03:29:24.040 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode16 --rbd-pool mypool --rbd-image myimage61 --load-balancing-group 2 2026-02-18T03:29:24.073 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 155 to 156 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:1684 (108): Start update from 155 to 156 (discovery-trial155). 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:2068 (108): Update complete (155 -> 156) (discovery-trial155). 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.763835] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.768427] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:23.768454] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (155 -> 156) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.077 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:1684 (141): Start update from 155 to 156 (discovery-trial086). 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 155 to 156 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:2068 (141): Update complete (155 -> 156) (discovery-trial086). 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.758240] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.762867] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:23.762901] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (155 -> 156) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.078 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:1684 (2): Start update from 155 to 156 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:1684 (129): Start update from 155 to 156 (discovery-trial177). 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:2068 (129): Update complete (155 -> 156) (discovery-trial177). 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.760690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.765036] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:23.765057] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] INFO state.py:2068 (2): Update complete (155 -> 156) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:23 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:23] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/904153341' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-mon[21825]: pgmap v188: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/904153341' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-mon[24100]: pgmap v188: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:24.435 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/904153341' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:24.435 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-mon[24719]: pgmap v188: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO state.py:1684 (129): Start update from 156 to 157 (discovery-trial177). 2026-02-18T03:29:24.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO state.py:2068 (129): Update complete (156 -> 157) (discovery-trial177). 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO state.py:1684 (2): Start update from 156 to 157 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:24.462197] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:24.466605] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:24.466627] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] INFO state.py:2068 (2): Update complete (156 -> 157) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO state.py:1684 (108): Start update from 156 to 157 (discovery-trial155). 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO state.py:2068 (108): Update complete (156 -> 157) (discovery-trial155). 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO state.py:1684 (2): Start update from 156 to 157 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:24.461184] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:24.465753] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:24.465778] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] INFO state.py:2068 (2): Update complete (156 -> 157) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO state.py:1684 (84): Start update from 156 to 157 (discovery-trial034). 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO state.py:2068 (84): Update complete (156 -> 157) (discovery-trial034). 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:39916 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage61, no need to remove 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:39916 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.628010] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: , client address: IPv4 10.20.193.14:39916 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.632506] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.632531] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode16_1, OMAP version: 158 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:24] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.732435] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:24.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:24.732465] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:24.736 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:29:24.757 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:24.757 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:24.757 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage62 2026-02-18T03:29:24.757 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode16 --rbd-pool mypool --rbd-image myimage62 --load-balancing-group 3 2026-02-18T03:29:24.803 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:24Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO state.py:1684 (141): Start update from 156 to 157 (discovery-trial086). 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO state.py:2068 (141): Update complete (156 -> 157) (discovery-trial086). 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO state.py:1684 (2): Start update from 156 to 157 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:24.455723] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:24.460479] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:24.460507] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] INFO state.py:2068 (2): Update complete (156 -> 157) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:24.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:24] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:1684 (84): Start update from 157 to 158 (discovery-trial034). 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:2068 (84): Update complete (157 -> 158) (discovery-trial034). 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:50526 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage62, no need to remove 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:50526 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:25.346213] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: , client address: IPv4 10.20.193.14:50526 2026-02-18T03:29:25.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:25.350669] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:25.350691] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode16_2, OMAP version: 159 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:25.449985] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:25.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:25.450013] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:25.454 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:29:25.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:1684 (129): Start update from 157 to 158 (discovery-trial177). 2026-02-18T03:29:25.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:2068 (129): Update complete (157 -> 158) (discovery-trial177). 2026-02-18T03:29:25.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 157 to 158 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:25.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:25.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.183375] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.187745] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.187765] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (157 -> 158) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.475 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:25.475 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:25.475 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage63 2026-02-18T03:29:25.475 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode16 --rbd-pool mypool --rbd-image myimage63 --load-balancing-group 4 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:1684 (108): Start update from 157 to 158 (discovery-trial155). 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:2068 (108): Update complete (157 -> 158) (discovery-trial155). 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 157 to 158 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.186260] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.190797] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.190823] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (157 -> 158) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.511 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:1684 (141): Start update from 157 to 158 (discovery-trial086). 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:2068 (141): Update complete (157 -> 158) (discovery-trial086). 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 157 to 158 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.180859] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:29:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.185290] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:29:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.185319] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:29:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (157 -> 158) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.145 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3029503189' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:26.145 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-mon[21825]: pgmap v189: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.6 MiB/s rd, 6.5 KiB/s wr, 1.24k op/s 2026-02-18T03:29:26.145 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:1684 (84): Start update from 158 to 159 (discovery-trial034). 2026-02-18T03:29:26.145 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:2068 (84): Update complete (158 -> 159) (discovery-trial034). 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:43784 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage63, no need to remove 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:25] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:43784 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.039326] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: , client address: IPv4 10.20.193.14:43784 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.043905] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.043927] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode16_3, OMAP version: 160 2026-02-18T03:29:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.144522] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.144558] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:26.149 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:29:26.170 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:26.170 INFO:tasks.workunit.client.0.trial014.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2026-02-18T03:29:26.170 INFO:tasks.workunit.client.0.trial014.stderr:+ image=myimage64 2026-02-18T03:29:26.170 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode16 --rbd-pool mypool --rbd-image myimage64 --load-balancing-group 1 2026-02-18T03:29:26.208 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 158 to 159 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:1684 (129): Start update from 158 to 159 (discovery-trial177). 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:2068 (129): Update complete (158 -> 159) (discovery-trial177). 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.897947] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.902336] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:25.902356] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:25 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (158 -> 159) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3029503189' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:26.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-mon[24719]: pgmap v189: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.6 MiB/s rd, 6.5 KiB/s wr, 1.24k op/s 2026-02-18T03:29:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:1684 (108): Start update from 158 to 159 (discovery-trial155). 2026-02-18T03:29:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:2068 (108): Update complete (158 -> 159) (discovery-trial155). 2026-02-18T03:29:26.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 158 to 159 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.903884] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.908527] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:25.908552] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (158 -> 159) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3029503189' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-mon[24100]: pgmap v189: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.6 MiB/s rd, 6.5 KiB/s wr, 1.24k op/s 2026-02-18T03:29:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:1684 (141): Start update from 158 to 159 (discovery-trial086). 2026-02-18T03:29:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:2068 (141): Update complete (158 -> 159) (discovery-trial086). 2026-02-18T03:29:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:1684 (2): Start update from 158 to 159 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.899635] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.906829] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:25.906870] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:25] INFO state.py:2068 (2): Update complete (158 -> 159) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.855 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO state.py:1684 (84): Start update from 159 to 160 (discovery-trial034). 2026-02-18T03:29:26.855 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO state.py:2068 (84): Update complete (159 -> 160) (discovery-trial034). 2026-02-18T03:29:26.855 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO grpc.py:2756 (2): Received request to add namespace to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: , client address: IPv4 10.20.193.14:48864 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO cephutils.py:599 (2): No metadata reservation_key for image mypool/myimage64, no need to remove 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO cephutils.py:122 (2): Caching response of the monitor: [1, 2, 3, 4] 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO state.py:603 (2): Succeeded to lock OMAP file (exclusive) after 1 retries 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=, client address: IPv4 10.20.193.14:48864 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.753965] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: , client address: IPv4 10.20.193.14:48864 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.758448] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.758472] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] INFO state.py:1053 (2): omap_key generated: namespace_nqn.2016-06.io.spdk:cnode16_4, OMAP version: 161 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] WARNING state.py:640 (84): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.854560] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:29:26.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [2026-02-18 03:29:26.854591] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:29:26.858 INFO:tasks.workunit.client.0.trial014.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode16: Successful 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO state.py:1684 (141): Start update from 159 to 160 (discovery-trial086). 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO state.py:2068 (141): Update complete (159 -> 160) (discovery-trial086). 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO state.py:1684 (2): Start update from 159 to 160 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:26.593345] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:29:26.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:26.597855] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:29:26.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:26.597881] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:26.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] INFO state.py:2068 (2): Update complete (159 -> 160) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:26.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] WARNING state.py:640 (141): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.879 INFO:tasks.workunit.client.0.trial014.stderr:+ (( image_index++ )) 2026-02-18T03:29:26.879 INFO:tasks.workunit.client.0.trial014.stderr:+ list_subsystems 2026-02-18T03:29:26.879 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:29:26.880 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.34 2026-02-18T03:29:26.880 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.34 --server-port 5500 --format json subsystem list 2026-02-18T03:29:26.923 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO state.py:1684 (129): Start update from 159 to 160 (discovery-trial177). 2026-02-18T03:29:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO state.py:2068 (129): Update complete (159 -> 160) (discovery-trial177). 2026-02-18T03:29:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO state.py:1684 (2): Start update from 159 to 160 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:26.598901] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:26.603327] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:26.603350] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] INFO state.py:2068 (2): Update complete (159 -> 160) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:26 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:26] WARNING state.py:640 (129): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO state.py:1684 (108): Start update from 159 to 160 (discovery-trial155). 2026-02-18T03:29:26.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO state.py:2068 (108): Update complete (159 -> 160) (discovery-trial155). 2026-02-18T03:29:26.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO state.py:1684 (2): Start update from 159 to 160 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:26.597028] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:26.608248] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:26.608277] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] INFO state.py:2068 (2): Update complete (159 -> 160) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] WARNING state.py:640 (108): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:26] WARNING state.py:640 (2): The OMAP file is locked, will try again in 0.5 seconds 2026-02-18T03:29:27.386 INFO:tasks.workunit.client.0.trial014.stdout:{ 2026-02-18T03:29:27.386 INFO:tasks.workunit.client.0.trial014.stdout: "error_message": "Success", 2026-02-18T03:29:27.386 INFO:tasks.workunit.client.0.trial014.stdout: "subsystems": [ 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph14926682106859", 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode10", 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph55936123663244", 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.388 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode11", 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.389 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph70783795201823", 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.390 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode12", 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph75694736504890", 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.391 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode13", 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph51496246911324", 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.392 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode14", 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph65615196794868", 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.393 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode15", 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.394 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph33754540835311", 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.395 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode16", 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph66503271982671", 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.396 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph91399272374620", 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.397 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.398 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph61801836239121", 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.399 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode4", 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph56247354555456", 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.400 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode5", 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph40845607382583", 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.401 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode6", 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph50531101135613", 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.402 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode7", 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph68079984791060", 2026-02-18T03:29:27.403 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode8", 2026-02-18T03:29:27.404 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph54002212482360", 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.405 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode9", 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph48985563661949", 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 1, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 2040, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.406 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout: } 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout: ], 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout: "status": 0 2026-02-18T03:29:27.407 INFO:tasks.workunit.client.0.trial014.stdout:} 2026-02-18T03:29:27.408 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:29:27.408 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.86 2026-02-18T03:29:27.408 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.86 --server-port 5500 --format json subsystem list 2026-02-18T03:29:27.445 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO state.py:1684 (141): Start update from 160 to 161 (discovery-trial086). 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO state.py:2068 (141): Update complete (160 -> 161) (discovery-trial086). 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO state.py:1684 (2): Start update from 160 to 161 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:27.311634] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:27.316158] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [2026-02-18 03:29:27.316184] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:27.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO state.py:2068 (2): Update complete (160 -> 161) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:29:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO state.py:1684 (2): Start update from 160 to 161 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:27.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO state.py:1684 (129): Start update from 160 to 161 (discovery-trial177). 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO state.py:2068 (129): Update complete (160 -> 161) (discovery-trial177). 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:27.308755] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:27.313128] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:29:27.313149] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:27.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:27 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:27] INFO state.py:2068 (2): Update complete (160 -> 161) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:29:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO state.py:1684 (108): Start update from 160 to 161 (discovery-trial155). 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO state.py:1684 (2): Start update from 160 to 161 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO state.py:2068 (108): Update complete (160 -> 161) (discovery-trial155). 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:27.314860] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:27.319453] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [2026-02-18 03:29:27.319479] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:29:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:27] INFO state.py:2068 (2): Update complete (160 -> 161) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:29:27.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:27] INFO state.py:1684 (84): Start update from 160 to 161 (discovery-trial034). 2026-02-18T03:29:27.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:27] INFO state.py:2068 (84): Update complete (160 -> 161) (discovery-trial034). 2026-02-18T03:29:27.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:27] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.14:38990 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout:{ 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: "error_message": "Success", 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: "subsystems": [ 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.887 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph14926682106859", 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.888 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode10", 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph55936123663244", 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.889 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode11", 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph70783795201823", 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.890 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode12", 2026-02-18T03:29:27.891 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph75694736504890", 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.892 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode13", 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph51496246911324", 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.893 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode14", 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph65615196794868", 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.894 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode15", 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph33754540835311", 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.895 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode16", 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph66503271982671", 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.896 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:29:27.897 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph91399272374620", 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.898 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph61801836239121", 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.899 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode4", 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph56247354555456", 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.900 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode5", 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph40845607382583", 2026-02-18T03:29:27.901 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.902 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode6", 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph50531101135613", 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.903 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode7", 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph68079984791060", 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.904 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode8", 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph54002212482360", 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.905 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode9", 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph48985563661949", 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:27.906 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 2041, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 4080, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: } 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: ], 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout: "status": 0 2026-02-18T03:29:27.907 INFO:tasks.workunit.client.0.trial014.stdout:} 2026-02-18T03:29:27.908 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:29:27.908 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.155 2026-02-18T03:29:27.909 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.155 --server-port 5500 --format json subsystem list 2026-02-18T03:29:27.947 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:27Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:28.370 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1369455500' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:28.371 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:28 trial155 ceph-mon[24719]: pgmap v190: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.08k op/s 2026-02-18T03:29:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:28 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/1369455500' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:28 trial086 ceph-mon[24100]: pgmap v190: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.08k op/s 2026-02-18T03:29:28.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:27] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.14:56518 2026-02-18T03:29:28.382 INFO:tasks.workunit.client.0.trial014.stdout:{ 2026-02-18T03:29:28.382 INFO:tasks.workunit.client.0.trial014.stdout: "error_message": "Success", 2026-02-18T03:29:28.382 INFO:tasks.workunit.client.0.trial014.stdout: "subsystems": [ 2026-02-18T03:29:28.382 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph14926682106859", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode10", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph55936123663244", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode11", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph70783795201823", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.383 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode12", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph75694736504890", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode13", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph51496246911324", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode14", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph65615196794868", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.384 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode15", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph33754540835311", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode16", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph66503271982671", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph91399272374620", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.385 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph61801836239121", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode4", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph56247354555456", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode5", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph40845607382583", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.386 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode6", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph50531101135613", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode7", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph68079984791060", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode8", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph54002212482360", 2026-02-18T03:29:28.387 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode9", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph48985563661949", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 4081, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 6120, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: } 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: ], 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout: "status": 0 2026-02-18T03:29:28.388 INFO:tasks.workunit.client.0.trial014.stdout:} 2026-02-18T03:29:28.399 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in "${!gateway_ips[@]}" 2026-02-18T03:29:28.399 INFO:tasks.workunit.client.0.trial014.stderr:+ ip=10.20.193.177 2026-02-18T03:29:28.399 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo podman run -it quay.io/ceph/nvmeof-cli:devel --server-address 10.20.193.177 --server-port 5500 --format json subsystem list 2026-02-18T03:29:28.434 INFO:tasks.workunit.client.0.trial014.stderr:time="2026-02-18T03:29:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2026-02-18T03:29:28.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1369455500' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:28.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:28 trial034 ceph-mon[21825]: pgmap v190: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.08k op/s 2026-02-18T03:29:28.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:29:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:29:28] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.14:55646 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout:{ 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: "error_message": "Success", 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: "subsystems": [ 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.888 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph14926682106859", 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.889 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode10", 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph55936123663244", 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.890 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode11", 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph70783795201823", 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.891 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode12", 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph75694736504890", 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.892 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode13", 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.893 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph51496246911324", 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.894 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode14", 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph65615196794868", 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.895 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode15", 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph33754540835311", 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.896 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode16", 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph66503271982671", 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.897 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph91399272374620", 2026-02-18T03:29:28.898 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:29:28.899 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph61801836239121", 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.900 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode4", 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph56247354555456", 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.901 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode5", 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph40845607382583", 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.902 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode6", 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph50531101135613", 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.903 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode7", 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph68079984791060", 2026-02-18T03:29:28.904 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode8", 2026-02-18T03:29:28.905 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph54002212482360", 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.906 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: }, 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: { 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "nqn": "nqn.2016-06.io.spdk:cnode9", 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "enable_ha": true, 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "serial_number": "Ceph48985563661949", 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "model_number": "Ceph bdev Controller", 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "min_cntlid": 6121, 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "max_cntlid": 8160, 2026-02-18T03:29:28.907 INFO:tasks.workunit.client.0.trial014.stdout: "namespace_count": 4, 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "subtype": "NVMe", 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "max_namespaces": 512, 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "has_dhchap_key": false, 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "allow_any_host": true, 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "created_without_key": false, 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "network_mask": [] 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: } 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: ], 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout: "status": 0 2026-02-18T03:29:28.908 INFO:tasks.workunit.client.0.trial014.stdout:} 2026-02-18T03:29:28.909 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Subsystem setup done 2026-02-18T03:29:28.910 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Subsystem setup done' 2026-02-18T03:29:28.910 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:29:28.911 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:29:28.977 INFO:tasks.workunit:Running workunits matching nvmeof/basic_tests.sh on client.0... 2026-02-18T03:29:28.980 INFO:tasks.workunit:Running workunit nvmeof/basic_tests.sh... 2026-02-18T03:29:28.980 DEBUG:teuthology.orchestra.run.trial014:workunit test nvmeof/basic_tests.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/basic_tests.sh 2026-02-18T03:29:29.035 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo modprobe nvme-fabrics 2026-02-18T03:29:29.049 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo modprobe nvme-tcp 2026-02-18T03:29:29.062 INFO:tasks.workunit.client.0.trial014.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.066 INFO:tasks.workunit.client.0.trial014.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:29:29.066 INFO:tasks.workunit.client.0.trial014.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:29:29.144 INFO:tasks.workunit.client.0.trial014.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1123k 100 1123k 0 0 14.0M 0 --:--:-- --:--:-- --:--:-- 14.0M 2026-02-18T03:29:29.144 INFO:tasks.workunit.client.0.trial014.stderr:+ curl -O https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.148 INFO:tasks.workunit.client.0.trial014.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2026-02-18T03:29:29.148 INFO:tasks.workunit.client.0.trial014.stderr: Dload Upload Total Spent Left Speed 2026-02-18T03:29:29.174 INFO:tasks.workunit.client.0.trial014.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 110k 100 110k 0 0 4259k 0 --:--:-- --:--:-- --:--:-- 4259k 2026-02-18T03:29:29.174 INFO:tasks.workunit.client.0.trial014.stderr:+ ls -l nvme-cli-2.13-1.el9.x86_64.rpm libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.175 INFO:tasks.workunit.client.0.trial014.stdout:-rw-r--r--. 1 ubuntu ubuntu 113417 Feb 18 03:29 libnvme-1.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.175 INFO:tasks.workunit.client.0.trial014.stdout:-rw-r--r--. 1 ubuntu ubuntu 1149997 Feb 18 03:29 nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.176 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo rpm -qp --qf '%{NAME}-%{VERSION}-%{RELEASE}.%{ARCH}\n' nvme-cli-2.13-1.el9.x86_64.rpm 2026-02-18T03:29:29.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:29:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:29:28] INFO grpc.py:6821 (2): Received request to list all subsystems, context: , client address: IPv4 10.20.193.14:38836 2026-02-18T03:29:29.222 INFO:tasks.workunit.client.0.trial014.stdout:nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:29:29.223 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo dnf downgrade ./nvme-cli-2.13-1.el9.x86_64.rpm ./libnvme-1.13-1.el9.x86_64.rpm -y 2026-02-18T03:29:29.519 INFO:tasks.workunit.client.0.trial014.stdout:Last metadata expiration check: 0:06:38 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:29:29.644 INFO:tasks.workunit.client.0.trial014.stdout:Dependencies resolved. 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout:Downgrading: 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout: libnvme x86_64 1.13-1.el9 @commandline 111 k 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout: nvme-cli x86_64 2.13-1.el9 @commandline 1.1 M 2026-02-18T03:29:29.645 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:Transaction Summary 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:Downgrade 2 Packages 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:Total size: 1.2 M 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:Downloading Packages: 2026-02-18T03:29:29.646 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction check 2026-02-18T03:29:29.650 INFO:tasks.workunit.client.0.trial014.stdout:Transaction check succeeded. 2026-02-18T03:29:29.650 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction test 2026-02-18T03:29:29.692 INFO:tasks.workunit.client.0.trial014.stdout:Transaction test succeeded. 2026-02-18T03:29:29.692 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction 2026-02-18T03:29:29.754 INFO:tasks.workunit.client.0.trial014.stdout: Preparing : 1/1 2026-02-18T03:29:29.872 INFO:tasks.workunit.client.0.trial014.stdout: Downgrading : libnvme-1.13-1.el9.x86_64 1/4 2026-02-18T03:29:29.875 INFO:tasks.workunit.client.0.trial014.stdout: Downgrading : nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:29:30.066 INFO:tasks.workunit.client.0.trial014.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 2/4 2026-02-18T03:29:30.069 INFO:tasks.workunit.client.0.trial014.stdout: Cleanup : nvme-cli-2.16-1.el9.x86_64 3/4 2026-02-18T03:29:30.091 INFO:tasks.workunit.client.0.trial014.stdout: Cleanup : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:29:30.345 INFO:tasks.workunit.client.0.trial014.stdout: Running scriptlet: libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:29:30.345 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/4 2026-02-18T03:29:30.345 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 2/4 2026-02-18T03:29:30.345 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : libnvme-1.13-1.el9.x86_64 3/4 2026-02-18T03:29:30.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:30 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1836682671' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:30 trial086 ceph-mon[24100]: pgmap v191: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:30.402 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 4/4 2026-02-18T03:29:30.402 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:29:30.403 INFO:tasks.workunit.client.0.trial014.stdout:Downgraded: 2026-02-18T03:29:30.403 INFO:tasks.workunit.client.0.trial014.stdout: libnvme-1.13-1.el9.x86_64 nvme-cli-2.13-1.el9.x86_64 2026-02-18T03:29:30.403 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:29:30.403 INFO:tasks.workunit.client.0.trial014.stdout:Complete! 2026-02-18T03:29:30.430 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo lsmod 2026-02-18T03:29:30.430 INFO:tasks.workunit.client.0.trial014.stderr:+ grep nvme 2026-02-18T03:29:30.443 INFO:tasks.workunit.client.0.trial014.stdout:nvme_tcp 102400 0 2026-02-18T03:29:30.443 INFO:tasks.workunit.client.0.trial014.stdout:nvme_fabrics 49152 1 nvme_tcp 2026-02-18T03:29:30.444 INFO:tasks.workunit.client.0.trial014.stdout:nvme 65536 7 2026-02-18T03:29:30.444 INFO:tasks.workunit.client.0.trial014.stdout:nvme_core 274432 10 nvme_tcp,nvme,nvme_fabrics 2026-02-18T03:29:30.444 INFO:tasks.workunit.client.0.trial014.stdout:nvme_keyring 20480 3 nvme_tcp,nvme_core,nvme_fabrics 2026-02-18T03:29:30.444 INFO:tasks.workunit.client.0.trial014.stdout:nvme_auth 36864 1 nvme_core 2026-02-18T03:29:30.444 INFO:tasks.workunit.client.0.trial014.stderr:+ nvme version 2026-02-18T03:29:30.445 INFO:tasks.workunit.client.0.trial014.stdout:nvme version 2.13 (git 2.13) 2026-02-18T03:29:30.445 INFO:tasks.workunit.client.0.trial014.stdout:libnvme version 1.13 (git 1.13) 2026-02-18T03:29:30.446 INFO:tasks.workunit.client.0.trial014.stderr:+ source /etc/ceph/nvmeof.env 2026-02-18T03:29:30.446 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=10.20.193.34,10.20.193.86,10.20.193.155,10.20.193.177 2026-02-18T03:29:30.446 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_GATEWAY_NAMES=trial034,trial086,trial155,trial177 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=10.20.193.34 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_CLI_IMAGE=quay.io/ceph/nvmeof-cli:devel 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=16 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_NAMESPACES_COUNT=4 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_PORT=4420 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:++ NVMEOF_SRPORT=5500 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:+ SPDK_CONTROLLER='Ceph bdev Controller' 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:+ DISCOVERY_PORT=8009 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run disconnect_all 2026-02-18T03:29:30.447 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:29:30.448 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:29:30.448 INFO:tasks.workunit.client.0.trial014.stderr:+ disconnect_all 2026-02-18T03:29:30.448 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo nvme disconnect-all 2026-02-18T03:29:30.456 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list 2026-02-18T03:29:30.467 INFO:tasks.workunit.client.0.trial014.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:29:30.467 INFO:tasks.workunit.client.0.trial014.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:29:30.467 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:29:30.468 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:29:30.469 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:29:30.469 INFO:tasks.workunit.client.0.trial014.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:29:30.469 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:30.469 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:29:30.470 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:29:30.470 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run discovery 2026-02-18T03:29:30.470 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: discovery 2026-02-18T03:29:30.471 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: discovery' 2026-02-18T03:29:30.471 INFO:tasks.workunit.client.0.trial014.stderr:+ discovery 2026-02-18T03:29:30.471 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme discover -t tcp -a 10.20.193.34 -s 8009 2026-02-18T03:29:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:30 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1836682671' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:30 trial155 ceph-mon[24719]: pgmap v191: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:30.487 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1836682671' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:30.487 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-mon[21825]: pgmap v191: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 4.8 KiB/s wr, 1.05k op/s 2026-02-18T03:29:30.667 INFO:tasks.workunit.client.0.trial014.stderr:+ output=' 2026-02-18T03:29:30.667 INFO:tasks.workunit.client.0.trial014.stderr:Discovery Log Number of Records 64, Generation counter 1 2026-02-18T03:29:30.667 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:29:30.667 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:portid: 0 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:29:30.668 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:portid: 1 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:29:30.669 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:portid: 2 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.670 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:portid: 3 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.671 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:portid: 4 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:portid: 5 2026-02-18T03:29:30.672 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:portid: 6 2026-02-18T03:29:30.673 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:portid: 7 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.674 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:portid: 8 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.675 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:portid: 9 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.676 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:portid: 10 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:29:30.677 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:portid: 11 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 12====== 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.678 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:portid: 12 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 13====== 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.679 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:portid: 13 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 14====== 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.680 INFO:tasks.workunit.client.0.trial014.stderr:portid: 14 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 15====== 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:portid: 15 2026-02-18T03:29:30.681 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 16====== 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:portid: 16 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.682 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 17====== 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:portid: 17 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.683 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 18====== 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:portid: 18 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.684 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 19====== 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:portid: 19 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.685 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 20====== 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:portid: 20 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.686 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 21====== 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:portid: 21 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 22====== 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.687 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:portid: 22 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 23====== 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.688 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:portid: 23 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 24====== 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.689 INFO:tasks.workunit.client.0.trial014.stderr:portid: 24 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 25====== 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:portid: 25 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.690 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 26====== 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:portid: 26 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.691 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 27====== 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:portid: 27 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.692 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 28====== 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:portid: 28 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 29====== 2026-02-18T03:29:30.693 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:portid: 29 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 30====== 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.694 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:portid: 30 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 31====== 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.695 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:portid: 31 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 32====== 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:portid: 32 2026-02-18T03:29:30.696 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 33====== 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:portid: 33 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.697 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 34====== 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:portid: 34 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.698 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 35====== 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:portid: 35 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.699 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 36====== 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:portid: 36 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.700 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 37====== 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:portid: 37 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 38====== 2026-02-18T03:29:30.701 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:portid: 38 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 39====== 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.702 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:portid: 39 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 40====== 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.703 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:portid: 40 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 41====== 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.704 INFO:tasks.workunit.client.0.trial014.stderr:portid: 41 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 42====== 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:portid: 42 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.705 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 43====== 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:portid: 43 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.706 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 44====== 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:portid: 44 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 45====== 2026-02-18T03:29:30.707 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:portid: 45 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 46====== 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.708 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:portid: 46 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 47====== 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:portid: 47 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.709 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 48====== 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:portid: 48 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 49====== 2026-02-18T03:29:30.710 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:portid: 49 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 50====== 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:portid: 50 2026-02-18T03:29:30.711 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 51====== 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:portid: 51 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.712 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 52====== 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:portid: 52 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 53====== 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.713 INFO:tasks.workunit.client.0.trial014.stderr:portid: 53 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 54====== 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:portid: 54 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 55====== 2026-02-18T03:29:30.714 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:portid: 55 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 56====== 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:portid: 56 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.715 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 57====== 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:portid: 57 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 58====== 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.716 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:portid: 58 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 59====== 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:portid: 59 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 60====== 2026-02-18T03:29:30.717 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:portid: 60 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 61====== 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:portid: 61 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.718 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 62====== 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:portid: 62 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 63====== 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:portid: 63 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.719 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none' 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:+ expected_discovery_stdout='subtype: nvme subsystem' 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:+ echo ' 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:Discovery Log Number of Records 64, Generation counter 1 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 0====== 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:portid: 0 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 1====== 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.720 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:portid: 1 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 2====== 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:portid: 2 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 3====== 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.721 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:portid: 3 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode10 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 4====== 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:portid: 4 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.722 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 5====== 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:portid: 5 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 6====== 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:portid: 6 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.723 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 7====== 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:portid: 7 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode11 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 8====== 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:portid: 8 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.724 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 9====== 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:portid: 9 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 10====== 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:portid: 10 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.725 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 11====== 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:portid: 11 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode12 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 12====== 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:portid: 12 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.726 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 13====== 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:portid: 13 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 14====== 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:portid: 14 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.727 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 15====== 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:portid: 15 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode13 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 16====== 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:portid: 16 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 17====== 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.728 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:portid: 17 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 18====== 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:portid: 18 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 19====== 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.729 INFO:tasks.workunit.client.0.trial014.stderr:portid: 19 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode14 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 20====== 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:portid: 20 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 21====== 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:portid: 21 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.730 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 22====== 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:portid: 22 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 23====== 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:portid: 23 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode15 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 24====== 2026-02-18T03:29:30.731 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:portid: 24 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 25====== 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:portid: 25 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 26====== 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.732 INFO:tasks.workunit.client.0.trial014.stderr:portid: 26 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 27====== 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:portid: 27 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode16 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 28====== 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:portid: 28 2026-02-18T03:29:30.733 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 29====== 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:portid: 29 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 30====== 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:portid: 30 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.734 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 31====== 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:portid: 31 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 32====== 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:portid: 32 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 33====== 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:portid: 33 2026-02-18T03:29:30.735 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 34====== 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:portid: 34 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 35====== 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:portid: 35 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 36====== 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.736 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:portid: 36 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 37====== 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:portid: 37 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 38====== 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:portid: 38 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.737 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 39====== 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:portid: 39 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 40====== 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:portid: 40 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 41====== 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:portid: 41 2026-02-18T03:29:30.738 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 42====== 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:portid: 42 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 43====== 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:portid: 43 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode4 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 44====== 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.739 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:portid: 44 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 45====== 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:portid: 45 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 46====== 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:portid: 46 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.740 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 47====== 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:portid: 47 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode5 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 48====== 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:portid: 48 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 49====== 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:portid: 49 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.741 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 50====== 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:portid: 50 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 51====== 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:portid: 51 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode6 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 52====== 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:portid: 52 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.742 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 53====== 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:portid: 53 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 54====== 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:portid: 54 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 55====== 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:portid: 55 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.743 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode7 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 56====== 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:portid: 56 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 57====== 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:portid: 57 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:+ grep -q 'subtype: nvme subsystem' 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 58====== 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:portid: 58 2026-02-18T03:29:30.744 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 59====== 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:portid: 59 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode8 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 60====== 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:portid: 60 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.34 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 61====== 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:portid: 61 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.745 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.86 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 62====== 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:portid: 62 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.155 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:=====Discovery Log Entry 63====== 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:trtype: tcp 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:adrfam: ipv4 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:subtype: nvme subsystem 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:treq: not required 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:portid: 63 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:trsvcid: 4420 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:subnqn: nqn.2016-06.io.spdk:cnode9 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:traddr: 10.20.193.177 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:eflags: none 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:sectype: none' 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:30.746 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] discovery test passed! 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] discovery test passed!' 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run connect 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: connect 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: connect' 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stderr:+ connect 2026-02-18T03:29:30.747 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo nvme connect -t tcp --traddr 10.20.193.34 -s 4420 -n nqn.2016-06.io.spdk:cnode1 2026-02-18T03:29:30.764 INFO:tasks.workunit.client.0.trial014.stdout:connecting to device: nvme3 2026-02-18T03:29:30.770 INFO:tasks.workunit.client.0.trial014.stderr:+ sleep 5 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:30] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3661185776' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4243908195' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/144819715' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/978707848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1583213450' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1301583163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/77830079' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1715964667' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1282466392' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/798190987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1106428765' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2252635800' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/151039229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/798234691' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2685691939' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3978281790' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4231799731' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1023684591' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:31 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/3323079105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3661185776' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4243908195' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/144819715' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/978707848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1583213450' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1301583163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/77830079' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1715964667' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1282466392' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/798190987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1106428765' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2252635800' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/151039229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/798234691' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2685691939' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3978281790' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4231799731' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1023684591' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3323079105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3661185776' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4243908195' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/144819715' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/978707848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1583213450' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1301583163' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/77830079' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1715964667' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1282466392' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/798190987' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1106428765' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2252635800' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/151039229' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/798234691' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2685691939' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3978281790' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4231799731' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1023684591' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:31.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3323079105' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:32.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:32 trial086 ceph-mon[24100]: pgmap v192: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.4 MiB/s rd, 5.3 KiB/s wr, 1.07k op/s 2026-02-18T03:29:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:32 trial155 ceph-mon[24719]: pgmap v192: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.4 MiB/s rd, 5.3 KiB/s wr, 1.07k op/s 2026-02-18T03:29:32.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:32 trial034 ceph-mon[21825]: pgmap v192: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.4 MiB/s rd, 5.3 KiB/s wr, 1.07k op/s 2026-02-18T03:29:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:33 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1052527740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:33 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1052527740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1052527740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:34 trial086 ceph-mon[24100]: pgmap v193: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 843 op/s 2026-02-18T03:29:34.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:34 trial155 ceph-mon[24719]: pgmap v193: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 843 op/s 2026-02-18T03:29:34.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:34 trial034 ceph-mon[21825]: pgmap v193: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 843 op/s 2026-02-18T03:29:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:35 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3338499047' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3338499047' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3338499047' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:35.771 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:29:35.785 INFO:tasks.workunit.client.0.trial014.stderr:+ output='{ 2026-02-18T03:29:35.785 INFO:tasks.workunit.client.0.trial014.stderr: "Devices":[ 2026-02-18T03:29:35.785 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.785 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E2MU200", 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"25174FCD65D8", 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":57087266816, 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":1875385008, 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":960197124096, 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.786 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E3MQ000", 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"012510B47B1C", 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":71010189312, 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":3750748848, 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.787 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E3MQ000", 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"012510B00421", 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":166678364160, 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":3750748848, 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.788 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":4, 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"25.09", 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"Ceph14926682106859", 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":8589934592, 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":16777216, 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":8589934592, 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.789 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr:}' 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '{ 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "Devices":[ 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme0n1", 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng0n1", 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E2MU200", 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"25174FCD65D8", 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":57087266816, 2026-02-18T03:29:35.790 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":1875385008, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":960197124096, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme1n1", 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng1n1", 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E3MQ000", 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"012510B47B1C", 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":71010189312, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":3750748848, 2026-02-18T03:29:35.791 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":1, 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme2n1", 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng2n1", 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"E3MQ000", 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"012510B00421", 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":166678364160, 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":3750748848, 2026-02-18T03:29:35.792 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":1920383410176, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "NameSpace":4, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "DevicePath":"/dev/nvme3n4", 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "GenericPath":"/dev/ng3n4", 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "Firmware":"25.09", 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "ModelNumber":"Ceph bdev Controller", 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "SerialNumber":"Ceph14926682106859", 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "UsedBytes":8589934592, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "MaximumLBA":16777216, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "PhysicalSize":8589934592, 2026-02-18T03:29:35.793 INFO:tasks.workunit.client.0.trial014.stderr: "SectorSize":512 2026-02-18T03:29:35.794 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.794 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.794 INFO:tasks.workunit.client.0.trial014.stderr:}' 2026-02-18T03:29:35.794 INFO:tasks.workunit.client.0.trial014.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:29:35.795 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:35.795 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] connect test passed!' 2026-02-18T03:29:35.795 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] connect test passed! 2026-02-18T03:29:35.795 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run list_subsys 1 2026-02-18T03:29:35.796 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:29:35.796 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:29:35.797 INFO:tasks.workunit.client.0.trial014.stderr:+ list_subsys 1 2026-02-18T03:29:35.797 INFO:tasks.workunit.client.0.trial014.stderr:+ expected_count=1 2026-02-18T03:29:35.797 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr:+ output='[ 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "Subsystems":[ 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys0", 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8", 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.798 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme0", 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:02:00.0", 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys1", 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C", 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.799 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme1", 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:03:00.0", 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys2", 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421", 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.800 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme2", 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:04:00.0", 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys3", 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.801 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme3", 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.802 INFO:tasks.workunit.client.0.trial014.stderr:]' 2026-02-18T03:29:35.803 INFO:tasks.workunit.client.0.trial014.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys3",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme3",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:29:35.803 INFO:tasks.workunit.client.0.trial014.stderr:++ grep -o '"tcp"' 2026-02-18T03:29:35.803 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -l 2026-02-18T03:29:35.804 INFO:tasks.workunit.client.0.trial014.stderr:+ multipath=1 2026-02-18T03:29:35.804 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 1 -ne 1 ']' 2026-02-18T03:29:35.804 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:35.804 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:29:35.804 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:29:35.805 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: disconnect_all 2026-02-18T03:29:35.805 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run disconnect_all 2026-02-18T03:29:35.805 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2026-02-18T03:29:35.805 INFO:tasks.workunit.client.0.trial014.stderr:+ disconnect_all 2026-02-18T03:29:35.806 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo nvme disconnect-all 2026-02-18T03:29:35.902 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list 2026-02-18T03:29:35.912 INFO:tasks.workunit.client.0.trial014.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:29:35.912 INFO:tasks.workunit.client.0.trial014.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:29:35.912 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:29:35.913 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:29:35.913 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:29:35.913 INFO:tasks.workunit.client.0.trial014.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 ' 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:+ grep -q 'Ceph bdev Controller' 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:35.914 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] disconnect_all test passed! 2026-02-18T03:29:35.915 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2026-02-18T03:29:35.915 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run list_subsys 0 2026-02-18T03:29:35.915 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:29:35.916 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:29:35.916 INFO:tasks.workunit.client.0.trial014.stderr:+ list_subsys 0 2026-02-18T03:29:35.916 INFO:tasks.workunit.client.0.trial014.stderr:+ expected_count=0 2026-02-18T03:29:35.916 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:29:35.924 INFO:tasks.workunit.client.0.trial014.stderr:+ output='[ 2026-02-18T03:29:35.924 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.924 INFO:tasks.workunit.client.0.trial014.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Subsystems":[ 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys0", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme0", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:02:00.0", 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.925 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys1", 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C", 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme1", 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:03:00.0", 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.926 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys2", 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421", 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme2", 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:04:00.0", 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.927 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.928 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.928 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:35.928 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:35.928 INFO:tasks.workunit.client.0.trial014.stderr:]' 2026-02-18T03:29:35.929 INFO:tasks.workunit.client.0.trial014.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:++ grep -o '"tcp"' 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -l 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:+ multipath=0 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:29:35.930 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:29:35.931 INFO:tasks.workunit.client.0.trial014.stderr:+ devices_count=64 2026-02-18T03:29:35.931 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run connect_all 64 2026-02-18T03:29:35.931 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: connect_all 2026-02-18T03:29:35.932 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: connect_all' 2026-02-18T03:29:35.932 INFO:tasks.workunit.client.0.trial014.stderr:+ connect_all 64 2026-02-18T03:29:35.932 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo nvme connect-all --traddr=10.20.193.34 --transport=tcp -l 3600 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: pgmap v194: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 996 KiB/s rd, 3.2 KiB/s wr, 635 op/s 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/609100051' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3411762372' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2237847085' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4173059063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3008256981' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1636921534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1098133361' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1645772912' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3996983543' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3885513929' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3399543243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1870652701' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3557364494' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1705727033' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/622641102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2357320368' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1345368241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:35] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:36] INFO state.py:603 (84): Succeeded to lock OMAP file (shared) after 1 retries 2026-02-18T03:29:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: pgmap v194: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 996 KiB/s rd, 3.2 KiB/s wr, 635 op/s 2026-02-18T03:29:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/609100051' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3411762372' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2237847085' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/4173059063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3008256981' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1636921534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1098133361' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1645772912' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3996983543' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3885513929' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3399543243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1870652701' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3557364494' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1705727033' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/622641102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2357320368' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:36 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/1345368241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: pgmap v194: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 996 KiB/s rd, 3.2 KiB/s wr, 635 op/s 2026-02-18T03:29:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/609100051' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3411762372' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2237847085' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4173059063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3008256981' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1636921534' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1098133361' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1645772912' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3996983543' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3885513929' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3399543243' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1870652701' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3557364494' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1705727033' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/622641102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2357320368' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:36.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:36 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1345368241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:37 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2312037522' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:37 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/1445921774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:37 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2312037522' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:37 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1445921774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2312037522' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw listeners", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1445921774' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:38 trial086 ceph-mon[24100]: pgmap v195: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 533 KiB/s rd, 1.3 KiB/s wr, 351 op/s 2026-02-18T03:29:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:38 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/126362162' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:38 trial155 ceph-mon[24719]: pgmap v195: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 533 KiB/s rd, 1.3 KiB/s wr, 351 op/s 2026-02-18T03:29:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:38 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/126362162' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:38 trial034 ceph-mon[21825]: pgmap v195: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 533 KiB/s rd, 1.3 KiB/s wr, 351 op/s 2026-02-18T03:29:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/126362162' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:39.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:39 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/952082374' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:39.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:39 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/952082374' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:39.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/952082374' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:40.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:40 trial086 ceph-mon[24100]: pgmap v196: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 478 KiB/s rd, 1.2 KiB/s wr, 277 op/s 2026-02-18T03:29:40.629 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:40 trial155 ceph-mon[24719]: pgmap v196: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 478 KiB/s rd, 1.2 KiB/s wr, 277 op/s 2026-02-18T03:29:40.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:40 trial034 ceph-mon[21825]: pgmap v196: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 478 KiB/s rd, 1.2 KiB/s wr, 277 op/s 2026-02-18T03:29:41.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:41 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3177575739' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:41.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3177575739' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:41.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:41 trial086 ceph-mon[24100]: from='client.? 10.20.193.86:0/3177575739' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:41.888 INFO:tasks.workunit.client.0.trial014.stderr:+ sleep 5 2026-02-18T03:29:42.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:42 trial155 ceph-mon[24719]: pgmap v197: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 682 B/s wr, 120 op/s 2026-02-18T03:29:42.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:42 trial034 ceph-mon[21825]: pgmap v197: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 682 B/s wr, 120 op/s 2026-02-18T03:29:42.872 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:42 trial086 ceph-mon[24100]: pgmap v197: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 453 KiB/s rd, 682 B/s wr, 120 op/s 2026-02-18T03:29:43.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:43 trial086 ceph-mon[24100]: from='client.? 10.20.193.155:0/2284236126' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:43.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:43 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2284236126' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:44.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:43 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2284236126' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:44.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:44 trial086 ceph-mon[24100]: pgmap v198: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 243 KiB/s rd, 0 B/s wr, 25 op/s 2026-02-18T03:29:44.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:44 trial155 ceph-mon[24719]: pgmap v198: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 243 KiB/s rd, 0 B/s wr, 25 op/s 2026-02-18T03:29:45.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:44 trial034 ceph-mon[21825]: pgmap v198: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 243 KiB/s rd, 0 B/s wr, 25 op/s 2026-02-18T03:29:45.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:45 trial086 ceph-mon[24100]: from='client.? 10.20.193.177:0/3728589896' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:45.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3728589896' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:46.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3728589896' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:46.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:46 trial086 ceph-mon[24100]: pgmap v199: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 281 KiB/s rd, 0 B/s wr, 29 op/s 2026-02-18T03:29:46.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:46 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/2550434585' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:46.889 INFO:tasks.workunit.client.0.trial014.stderr:+ expected_devices_count=64 2026-02-18T03:29:46.890 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:29:46.890 INFO:tasks.workunit.client.0.trial014.stderr:++ grep -o 'Ceph bdev Controller' 2026-02-18T03:29:46.890 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -l 2026-02-18T03:29:46.938 INFO:tasks.workunit.client.0.trial014.stderr:+ actual_devices=64 2026-02-18T03:29:46.938 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 64 -ne 64 ']' 2026-02-18T03:29:46.938 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:46.938 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] connect_all test passed! 2026-02-18T03:29:46.939 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] connect_all test passed!' 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:++ echo 10.20.193.34,10.20.193.86,10.20.193.155,10.20.193.177 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:++ tr -cd , 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -c 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:+ gateways_count=4 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:+ multipath_count=64 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stderr:+ test_run list_subsys 64 2026-02-18T03:29:46.940 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] Running test: list_subsys 2026-02-18T03:29:46.941 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] Running test: list_subsys' 2026-02-18T03:29:46.941 INFO:tasks.workunit.client.0.trial014.stderr:+ list_subsys 64 2026-02-18T03:29:46.941 INFO:tasks.workunit.client.0.trial014.stderr:+ expected_count=64 2026-02-18T03:29:46.941 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list-subsys --output-format=json 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr:+ output='[ 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: "HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc", 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: "Subsystems":[ 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.978 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys0", 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8", 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme0", 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:02:00.0", 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.979 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys1", 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C", 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme1", 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:03:00.0", 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.980 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys8", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode11", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme10", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme11", 2026-02-18T03:29:46.981 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme8", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme9", 2026-02-18T03:29:46.982 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys12", 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode12", 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme12", 2026-02-18T03:29:46.983 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme13", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme14", 2026-02-18T03:29:46.984 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme15", 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.985 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys16", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode13", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme16", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme17", 2026-02-18T03:29:46.986 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme18", 2026-02-18T03:29:46.987 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme19", 2026-02-18T03:29:46.988 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.989 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys2", 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421", 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme2", 2026-02-18T03:29:46.990 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"pcie", 2026-02-18T03:29:46.991 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"0000:04:00.0", 2026-02-18T03:29:46.991 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.991 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.991 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.991 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys20", 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode14", 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.992 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme20", 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.993 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme21", 2026-02-18T03:29:46.994 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.994 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.994 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.994 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.994 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme22", 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.995 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme23", 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.996 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys24", 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode15", 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.997 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme24", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme25", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.998 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme26", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme27", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:46.999 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys28", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode16", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme28", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme29", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.000 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme30", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme31", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys32", 2026-02-18T03:29:47.001 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme32", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme33", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme34", 2026-02-18T03:29:47.002 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme35", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys36", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode2", 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.003 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme36", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme37", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme38", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.004 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme39", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys4", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode10", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme4", 2026-02-18T03:29:47.005 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme5", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme6", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme7", 2026-02-18T03:29:47.006 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys40", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode3", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme40", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.007 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme41", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme42", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme43", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.008 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys44", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode4", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme44", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme45", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.009 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme46", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme47", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys48", 2026-02-18T03:29:47.010 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode5", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme48", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme49", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme50", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.011 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme51", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys52", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode6", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme52", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.012 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme53", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme54", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme55", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.013 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys56", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode7", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme56", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme57", 2026-02-18T03:29:47.014 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme58", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme59", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.015 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys60", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode8", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme60", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme61", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme62", 2026-02-18T03:29:47.016 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme63", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme-subsys64", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "NQN":"nqn.2016-06.io.spdk:cnode9", 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Paths":[ 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.017 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme64", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme65", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme66", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: }, 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: { 2026-02-18T03:29:47.018 INFO:tasks.workunit.client.0.trial014.stderr: "Name":"nvme67", 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: "Transport":"tcp", 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: "Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14", 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: "State":"live" 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: ] 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr: } 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:]' 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:++ grep -o '"tcp"' 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:++ wc -l 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"HostID":"29b84739-6e95-4147-8ccc-2ecd5be9eabc",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-25174FCD65D8",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B47B1C",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"pcie",' '"Address":"0000:03:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys8",' '"NQN":"nqn.2016-06.io.spdk:cnode11",' '"Paths":[' '{' '"Name":"nvme10",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme11",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme8",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme9",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys12",' '"NQN":"nqn.2016-06.io.spdk:cnode12",' '"Paths":[' '{' '"Name":"nvme12",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme13",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme14",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme15",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys16",' '"NQN":"nqn.2016-06.io.spdk:cnode13",' '"Paths":[' '{' '"Name":"nvme16",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme17",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme18",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme19",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-08.com.micron:nvme:nvm-subsystem-sn-012510B00421",' '"Paths":[' '{' '"Name":"nvme2",' '"Transport":"pcie",' '"Address":"0000:04:00.0",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys20",' '"NQN":"nqn.2016-06.io.spdk:cnode14",' '"Paths":[' '{' '"Name":"nvme20",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme21",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme22",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme23",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys24",' '"NQN":"nqn.2016-06.io.spdk:cnode15",' '"Paths":[' '{' '"Name":"nvme24",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme25",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme26",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme27",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys28",' '"NQN":"nqn.2016-06.io.spdk:cnode16",' '"Paths":[' '{' '"Name":"nvme28",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme29",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme30",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme31",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys32",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"Paths":[' '{' '"Name":"nvme32",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme33",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme34",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme35",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys36",' '"NQN":"nqn.2016-06.io.spdk:cnode2",' '"Paths":[' '{' '"Name":"nvme36",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme37",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme38",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme39",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys4",' '"NQN":"nqn.2016-06.io.spdk:cnode10",' '"Paths":[' '{' '"Name":"nvme4",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme5",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme6",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme7",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys40",' '"NQN":"nqn.2016-06.io.spdk:cnode3",' '"Paths":[' '{' '"Name":"nvme40",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme41",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme42",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme43",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys44",' '"NQN":"nqn.2016-06.io.spdk:cnode4",' '"Paths":[' '{' '"Name":"nvme44",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme45",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme46",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme47",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys48",' '"NQN":"nqn.2016-06.io.spdk:cnode5",' '"Paths":[' '{' '"Name":"nvme48",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme49",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme50",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme51",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys52",' '"NQN":"nqn.2016-06.io.spdk:cnode6",' '"Paths":[' '{' '"Name":"nvme52",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme53",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme54",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme55",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys56",' '"NQN":"nqn.2016-06.io.spdk:cnode7",' '"Paths":[' '{' '"Name":"nvme56",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme57",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme58",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme59",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys60",' '"NQN":"nqn.2016-06.io.spdk:cnode8",' '"Paths":[' '{' '"Name":"nvme60",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme61",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme62",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme63",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys64",' '"NQN":"nqn.2016-06.io.spdk:cnode9",' '"Paths":[' '{' '"Name":"nvme64",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme65",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme66",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '},' '{' '"Name":"nvme67",' '"Transport":"tcp",' '"Address":"traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:+ multipath=64 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 64 -ne 64 ']' 2026-02-18T03:29:47.019 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -eq 0 ']' 2026-02-18T03:29:47.020 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] list_subsys test passed!' 2026-02-18T03:29:47.020 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] list_subsys test passed! 2026-02-18T03:29:47.020 INFO:tasks.workunit.client.0.trial014.stdout:-------------Test Summary------------- 2026-02-18T03:29:47.020 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '-------------Test Summary-------------' 2026-02-18T03:29:47.021 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof] All nvmeof basic tests passed! 2026-02-18T03:29:47.021 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof] All nvmeof basic tests passed!' 2026-02-18T03:29:47.022 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:29:47.022 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:29:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:46 trial034 ceph-mon[21825]: pgmap v199: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 281 KiB/s rd, 0 B/s wr, 29 op/s 2026-02-18T03:29:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2550434585' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:47.023 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:46 trial155 ceph-mon[24719]: pgmap v199: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 281 KiB/s rd, 0 B/s wr, 29 op/s 2026-02-18T03:29:47.023 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:46 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2550434585' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:29:47.088 INFO:tasks.workunit:Stopping ['nvmeof/setup_subsystem.sh', 'nvmeof/basic_tests.sh'] on client.0... 2026-02-18T03:29:47.088 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T03:29:47.432 DEBUG:teuthology.parallel:result is None 2026-02-18T03:29:47.433 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:29:47.456 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:29:47.456 DEBUG:teuthology.orchestra.run.trial014:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:29:47.512 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:29:47.512 INFO:teuthology.run_tasks:Running task nvmeof.thrash... 2026-02-18T03:29:47.519 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list --output-format=json | jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2026-02-18T03:29:47.601 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 2026-02-18T03:29:47.601 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 2026-02-18T03:29:47.601 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 2026-02-18T03:29:47.601 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 2026-02-18T03:29:47.602 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 2026-02-18T03:29:47.603 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 2026-02-18T03:29:47.603 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-18T03:29:47.618 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-18T03:29:47.618 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T03:29:47.618 INFO:tasks.nvmeof.[nvmeof.thrasher]:start thrashing 2026-02-18T03:29:47.618 INFO:tasks.nvmeof.[nvmeof.thrasher]:seed: 1771385387, , max thrash delay: 90, min thrash delay: 60 max revive delay: 90, min revive delay: 60 daemons: 4 2026-02-18T03:29:47.618 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.a 2026-02-18T03:29:47.618 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon stop nvmeof.nvmeof.a 2026-02-18T03:29:47.808 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:29:47.808 INFO:teuthology.orchestra.run.trial034.stdout:{"epoch":51,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","created":"2026-02-18T03:24:09.561806+0000","modified":"2026-02-18T03:26:40.589075+0000","last_up_change":"2026-02-18T03:26:14.809888+0000","last_in_change":"2026-02-18T03:26:06.177707+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T03:25:32.017487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"mypool","create_time":"2026-02-18T03:26:26.902814+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ae662f-a3ac-441d-9153-38a88a7bf842","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6803","nonce":1922915375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6805","nonce":1922915375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6809","nonce":1922915375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":1922915375},{"type":"v1","addr":"10.20.193.34:6807","nonce":1922915375}]},"public_addr":"10.20.193.34:6803/1922915375","cluster_addr":"10.20.193.34:6805/1922915375","heartbeat_back_addr":"10.20.193.34:6809/1922915375","heartbeat_front_addr":"10.20.193.34:6807/1922915375","state":["exists","up"]},{"osd":1,"uuid":"3f1e47b0-0acf-4ee9-b252-59b70ac7bd0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6810","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6811","nonce":93492680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6812","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6813","nonce":93492680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6816","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6817","nonce":93492680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6814","nonce":93492680},{"type":"v1","addr":"10.20.193.34:6815","nonce":93492680}]},"public_addr":"10.20.193.34:6811/93492680","cluster_addr":"10.20.193.34:6813/93492680","heartbeat_back_addr":"10.20.193.34:6817/93492680","heartbeat_front_addr":"10.20.193.34:6815/93492680","state":["exists","up"]},{"osd":2,"uuid":"400d5239-cf11-4fca-8002-3840445a1f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6801","nonce":1601265450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6803","nonce":1601265450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6807","nonce":1601265450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":1601265450},{"type":"v1","addr":"10.20.193.86:6805","nonce":1601265450}]},"public_addr":"10.20.193.86:6801/1601265450","cluster_addr":"10.20.193.86:6803/1601265450","heartbeat_back_addr":"10.20.193.86:6807/1601265450","heartbeat_front_addr":"10.20.193.86:6805/1601265450","state":["exists","up"]},{"osd":3,"uuid":"ded6c259-415d-461a-a5ce-a00d62bd73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6809","nonce":3991930288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6811","nonce":3991930288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6815","nonce":3991930288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3991930288},{"type":"v1","addr":"10.20.193.86:6813","nonce":3991930288}]},"public_addr":"10.20.193.86:6809/3991930288","cluster_addr":"10.20.193.86:6811/3991930288","heartbeat_back_addr":"10.20.193.86:6815/3991930288","heartbeat_front_addr":"10.20.193.86:6813/3991930288","state":["exists","up"]},{"osd":4,"uuid":"54e189d7-b2a5-4897-a57e-592fc1d618e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6817","nonce":1439961886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6819","nonce":1439961886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6823","nonce":1439961886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1439961886},{"type":"v1","addr":"10.20.193.86:6821","nonce":1439961886}]},"public_addr":"10.20.193.86:6817/1439961886","cluster_addr":"10.20.193.86:6819/1439961886","heartbeat_back_addr":"10.20.193.86:6823/1439961886","heartbeat_front_addr":"10.20.193.86:6821/1439961886","state":["exists","up"]},{"osd":5,"uuid":"7f343de0-b850-4c6f-9d0d-f276ad601b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6801","nonce":2036977849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6803","nonce":2036977849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6807","nonce":2036977849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2036977849},{"type":"v1","addr":"10.20.193.155:6805","nonce":2036977849}]},"public_addr":"10.20.193.155:6801/2036977849","cluster_addr":"10.20.193.155:6803/2036977849","heartbeat_back_addr":"10.20.193.155:6807/2036977849","heartbeat_front_addr":"10.20.193.155:6805/2036977849","state":["exists","up"]},{"osd":6,"uuid":"086d2f3d-013a-4321-8d59-ed721774d8f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6809","nonce":3719862172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6811","nonce":3719862172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6815","nonce":3719862172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3719862172},{"type":"v1","addr":"10.20.193.155:6813","nonce":3719862172}]},"public_addr":"10.20.193.155:6809/3719862172","cluster_addr":"10.20.193.155:6811/3719862172","heartbeat_back_addr":"10.20.193.155:6815/3719862172","heartbeat_front_addr":"10.20.193.155:6813/3719862172","state":["exists","up"]},{"osd":7,"uuid":"0b6a80ea-96ac-4eb8-be91-242f4e82e06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6817","nonce":2769531031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6819","nonce":2769531031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6823","nonce":2769531031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":2769531031},{"type":"v1","addr":"10.20.193.155:6821","nonce":2769531031}]},"public_addr":"10.20.193.155:6817/2769531031","cluster_addr":"10.20.193.155:6819/2769531031","heartbeat_back_addr":"10.20.193.155:6823/2769531031","heartbeat_front_addr":"10.20.193.155:6821/2769531031","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:13.316258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:20.904292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:29.867784+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:38.779069+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:47.515808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:25:55.784403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:04.673928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T03:26:13.422028+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.34:0/906322023":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3729483561":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6801/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:6800/60826121":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/572041124":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/4275685682":"2026-02-19T03:24:29.805931+0000","10.20.193.34:0/3235393635":"2026-02-19T03:24:19.651106+0000","10.20.193.34:0/1369661688":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6801/272188705":"2026-02-19T03:24:19.651106+0000","10.20.193.34:6800/272188705":"2026-02-19T03:24:19.651106+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T03:29:47.817 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-18T03:25:32.017487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'mypool', 'create_time': '2026-02-18T03:26:26.902814+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-18T03:29:47.817 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-18T03:29:47.906 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to stop nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:29:47.919 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.b 2026-02-18T03:29:47.919 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon rm nvmeof.nvmeof.b 2026-02-18T03:29:48.008 INFO:teuthology.orchestra.run.trial034.stdout:pg_num: 1 2026-02-18T03:29:48.017 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:47 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3852215197' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:29:48.018 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get mypool pg_num 2026-02-18T03:29:48.122 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:47 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3852215197' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:29:48.210 INFO:teuthology.orchestra.run.trial034.stdout:pg_num: 32 2026-02-18T03:29:48.226 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-18T03:29:48.226 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T03:29:48.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:47 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3852215197' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-18T03:29:48.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:29:48.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:29:48.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:29:48.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.34:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.34:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:29:48.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 79 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:29:48.421 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:29:48.422 INFO:teuthology.orchestra.run.trial034.stderr:dumped all 2026-02-18T03:29:48.434 INFO:teuthology.orchestra.run.trial034.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-18T03:29:47.853577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":626350,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":55016,"num_read_kb":78054,"num_write":4142,"num_write_kb":3901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8294,"ondisk_log_size":8294,"up":99,"acting":99,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":5872025600,"kb_used":222968,"kb_used_data":7256,"kb_used_omap":425,"kb_used_meta":215126,"kb_avail":5871802632,"statfs":{"total":6012954214400,"available":6012725895168,"internally_reserved":0,"allocated":7430144,"data_stored":3605138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":436080,"internal_metadata":220289168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":1910,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001921"},"pg_stats":[{"pgid":"2.1f","version":"51'276","reported_seq":1654,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:45.074457+0000","last_change":"2026-02-18T03:26:30.928476+0000","last_active":"2026-02-18T03:29:45.074457+0000","last_peered":"2026-02-18T03:29:45.074457+0000","last_clean":"2026-02-18T03:29:45.074457+0000","last_became_active":"2026-02-18T03:26:28.875098+0000","last_became_peered":"2026-02-18T03:26:28.875098+0000","last_unstale":"2026-02-18T03:29:45.074457+0000","last_undegraded":"2026-02-18T03:29:45.074457+0000","last_fullsized":"2026-02-18T03:29:45.074457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:21:52.320628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027300700000000002,"stat_sum":{"num_bytes":1670,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3415,"num_read_kb":2958,"num_write":36,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"51'60","reported_seq":551,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.908231+0000","last_change":"2026-02-18T03:26:30.879720+0000","last_active":"2026-02-18T03:29:42.908231+0000","last_peered":"2026-02-18T03:29:42.908231+0000","last_clean":"2026-02-18T03:29:42.908231+0000","last_became_active":"2026-02-18T03:26:28.875687+0000","last_became_peered":"2026-02-18T03:26:28.875687+0000","last_unstale":"2026-02-18T03:29:42.908231+0000","last_undegraded":"2026-02-18T03:29:42.908231+0000","last_fullsized":"2026-02-18T03:29:42.908231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:02:43.573409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076759699999999996,"stat_sum":{"num_bytes":610,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":973,"num_read_kb":686,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"51'14","reported_seq":301,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:19.552105+0000","last_change":"2026-02-18T03:26:30.883566+0000","last_active":"2026-02-18T03:29:19.552105+0000","last_peered":"2026-02-18T03:29:19.552105+0000","last_clean":"2026-02-18T03:29:19.552105+0000","last_became_active":"2026-02-18T03:26:28.877036+0000","last_became_peered":"2026-02-18T03:26:28.877036+0000","last_unstale":"2026-02-18T03:29:19.552105+0000","last_undegraded":"2026-02-18T03:29:19.552105+0000","last_fullsized":"2026-02-18T03:29:19.552105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:14:34.096416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064737200000000001,"stat_sum":{"num_bytes":1717,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":415,"num_read_kb":136,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1c","version":"51'125","reported_seq":577,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:41.364201+0000","last_change":"2026-02-18T03:26:30.883647+0000","last_active":"2026-02-18T03:29:41.364201+0000","last_peered":"2026-02-18T03:29:41.364201+0000","last_clean":"2026-02-18T03:29:41.364201+0000","last_became_active":"2026-02-18T03:26:28.876499+0000","last_became_peered":"2026-02-18T03:26:28.876499+0000","last_unstale":"2026-02-18T03:29:41.364201+0000","last_undegraded":"2026-02-18T03:29:41.364201+0000","last_fullsized":"2026-02-18T03:29:41.364201+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:07:58.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068141600000000001,"stat_sum":{"num_bytes":1124,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":946,"num_read_kb":764,"num_write":77,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"51'162","reported_seq":919,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.931244+0000","last_change":"2026-02-18T03:26:30.883793+0000","last_active":"2026-02-18T03:29:44.931244+0000","last_peered":"2026-02-18T03:29:44.931244+0000","last_clean":"2026-02-18T03:29:44.931244+0000","last_became_active":"2026-02-18T03:26:28.876720+0000","last_became_peered":"2026-02-18T03:26:28.876720+0000","last_unstale":"2026-02-18T03:29:44.931244+0000","last_undegraded":"2026-02-18T03:29:44.931244+0000","last_fullsized":"2026-02-18T03:29:44.931244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:59:06.734438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842399999999997,"stat_sum":{"num_bytes":546,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1949,"num_read_kb":1742,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"51'169","reported_seq":1008,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.920215+0000","last_change":"2026-02-18T03:26:30.879103+0000","last_active":"2026-02-18T03:29:44.920215+0000","last_peered":"2026-02-18T03:29:44.920215+0000","last_clean":"2026-02-18T03:29:44.920215+0000","last_became_active":"2026-02-18T03:26:28.876480+0000","last_became_peered":"2026-02-18T03:26:28.876480+0000","last_unstale":"2026-02-18T03:29:44.920215+0000","last_undegraded":"2026-02-18T03:29:44.920215+0000","last_fullsized":"2026-02-18T03:29:44.920215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:04:51.993586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041648,"stat_sum":{"num_bytes":1654,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2039,"num_read_kb":1772,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.9","version":"51'59","reported_seq":346,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:47.719266+0000","last_change":"2026-02-18T03:26:30.879397+0000","last_active":"2026-02-18T03:29:47.719266+0000","last_peered":"2026-02-18T03:29:47.719266+0000","last_clean":"2026-02-18T03:29:47.719266+0000","last_became_active":"2026-02-18T03:26:28.876498+0000","last_became_peered":"2026-02-18T03:26:28.876498+0000","last_unstale":"2026-02-18T03:29:47.719266+0000","last_undegraded":"2026-02-18T03:29:47.719266+0000","last_fullsized":"2026-02-18T03:29:47.719266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:43:40.090906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071128100000000002,"stat_sum":{"num_bytes":1092,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":658,"num_read_kb":584,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"51'173","reported_seq":1088,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.121897+0000","last_change":"2026-02-18T03:26:30.881303+0000","last_active":"2026-02-18T03:29:44.121897+0000","last_peered":"2026-02-18T03:29:44.121897+0000","last_clean":"2026-02-18T03:29:44.121897+0000","last_became_active":"2026-02-18T03:26:28.875318+0000","last_became_peered":"2026-02-18T03:26:28.875318+0000","last_unstale":"2026-02-18T03:29:44.121897+0000","last_undegraded":"2026-02-18T03:29:44.121897+0000","last_fullsized":"2026-02-18T03:29:44.121897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:53:58.504617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067144800000000005,"stat_sum":{"num_bytes":2216,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2124,"num_read_kb":1800,"num_write":29,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"51'4557","reported_seq":9718,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.920682+0000","last_change":"2026-02-18T03:26:30.882045+0000","last_active":"2026-02-18T03:29:44.920682+0000","last_peered":"2026-02-18T03:29:44.920682+0000","last_clean":"2026-02-18T03:29:44.920682+0000","last_became_active":"2026-02-18T03:26:28.875365+0000","last_became_peered":"2026-02-18T03:26:28.875365+0000","last_unstale":"2026-02-18T03:29:44.920682+0000","last_undegraded":"2026-02-18T03:29:44.920682+0000","last_fullsized":"2026-02-18T03:29:44.920682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":4557,"log_dups_size":0,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:25:15.111389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072736299999999997,"stat_sum":{"num_bytes":562,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7405,"num_read_kb":38264,"num_write":3347,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'110","reported_seq":880,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:46.385246+0000","last_change":"2026-02-18T03:26:30.879819+0000","last_active":"2026-02-18T03:29:46.385246+0000","last_peered":"2026-02-18T03:29:46.385246+0000","last_clean":"2026-02-18T03:29:46.385246+0000","last_became_active":"2026-02-18T03:26:28.876556+0000","last_became_peered":"2026-02-18T03:26:28.876556+0000","last_unstale":"2026-02-18T03:29:46.385246+0000","last_undegraded":"2026-02-18T03:29:46.385246+0000","last_fullsized":"2026-02-18T03:29:46.385246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:26:39.338389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062329799999999999,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1616,"num_read_kb":1264,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'61","reported_seq":460,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.085234+0000","last_change":"2026-02-18T03:26:30.884004+0000","last_active":"2026-02-18T03:29:42.085234+0000","last_peered":"2026-02-18T03:29:42.085234+0000","last_clean":"2026-02-18T03:29:42.085234+0000","last_became_active":"2026-02-18T03:26:28.876686+0000","last_became_peered":"2026-02-18T03:26:28.876686+0000","last_unstale":"2026-02-18T03:29:42.085234+0000","last_undegraded":"2026-02-18T03:29:42.085234+0000","last_fullsized":"2026-02-18T03:29:42.085234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:22:28.566145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000711452,"stat_sum":{"num_bytes":1124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":818,"num_read_kb":636,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"51'12","reported_seq":195,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:20.251925+0000","last_change":"2026-02-18T03:26:30.879415+0000","last_active":"2026-02-18T03:29:20.251925+0000","last_peered":"2026-02-18T03:29:20.251925+0000","last_clean":"2026-02-18T03:29:20.251925+0000","last_became_active":"2026-02-18T03:26:28.875226+0000","last_became_peered":"2026-02-18T03:26:28.875226+0000","last_unstale":"2026-02-18T03:29:20.251925+0000","last_undegraded":"2026-02-18T03:29:20.251925+0000","last_fullsized":"2026-02-18T03:29:20.251925+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:30:16.188284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051818299999999997,"stat_sum":{"num_bytes":1686,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":84,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"51'115","reported_seq":808,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.923201+0000","last_change":"2026-02-18T03:26:30.881557+0000","last_active":"2026-02-18T03:29:44.923201+0000","last_peered":"2026-02-18T03:29:44.923201+0000","last_clean":"2026-02-18T03:29:44.923201+0000","last_became_active":"2026-02-18T03:26:28.876788+0000","last_became_peered":"2026-02-18T03:26:28.876788+0000","last_unstale":"2026-02-18T03:29:44.923201+0000","last_undegraded":"2026-02-18T03:29:44.923201+0000","last_fullsized":"2026-02-18T03:29:44.923201+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:43:22.679175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069877000000000003,"stat_sum":{"num_bytes":1140,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1546,"num_read_kb":1242,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"51'113","reported_seq":705,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.208204+0000","last_change":"2026-02-18T03:26:30.879654+0000","last_active":"2026-02-18T03:29:44.208204+0000","last_peered":"2026-02-18T03:29:44.208204+0000","last_clean":"2026-02-18T03:29:44.208204+0000","last_became_active":"2026-02-18T03:26:28.876707+0000","last_became_peered":"2026-02-18T03:26:28.876707+0000","last_unstale":"2026-02-18T03:29:44.208204+0000","last_undegraded":"2026-02-18T03:29:44.208204+0000","last_fullsized":"2026-02-18T03:29:44.208204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:23:52.206647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054380100000000001,"stat_sum":{"num_bytes":1108,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1386,"num_read_kb":1190,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"51'63","reported_seq":399,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.853689+0000","last_change":"2026-02-18T03:26:30.881372+0000","last_active":"2026-02-18T03:29:44.853689+0000","last_peered":"2026-02-18T03:29:44.853689+0000","last_clean":"2026-02-18T03:29:44.853689+0000","last_became_active":"2026-02-18T03:26:28.876802+0000","last_became_peered":"2026-02-18T03:26:28.876802+0000","last_unstale":"2026-02-18T03:29:44.853689+0000","last_undegraded":"2026-02-18T03:29:44.853689+0000","last_fullsized":"2026-02-18T03:29:44.853689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:46:08.030977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067318200000000003,"stat_sum":{"num_bytes":1654,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":743,"num_read_kb":612,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'70","reported_seq":412,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:39.914776+0000","last_change":"2026-02-18T03:26:30.928383+0000","last_active":"2026-02-18T03:29:39.914776+0000","last_peered":"2026-02-18T03:29:39.914776+0000","last_clean":"2026-02-18T03:29:39.914776+0000","last_became_active":"2026-02-18T03:26:28.877382+0000","last_became_peered":"2026-02-18T03:26:28.877382+0000","last_unstale":"2026-02-18T03:29:39.914776+0000","last_undegraded":"2026-02-18T03:29:39.914776+0000","last_fullsized":"2026-02-18T03:29:39.914776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:39:28.158951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026359000000000002,"stat_sum":{"num_bytes":2746,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":753,"num_read_kb":616,"num_write":21,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'132","reported_seq":251,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:27:45.093119+0000","last_change":"2026-02-18T03:26:00.249543+0000","last_active":"2026-02-18T03:27:45.093119+0000","last_peered":"2026-02-18T03:27:45.093119+0000","last_clean":"2026-02-18T03:27:45.093119+0000","last_became_active":"2026-02-18T03:26:00.249296+0000","last_became_peered":"2026-02-18T03:26:00.249296+0000","last_unstale":"2026-02-18T03:27:45.093119+0000","last_undegraded":"2026-02-18T03:27:45.093119+0000","last_fullsized":"2026-02-18T03:27:45.093119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_clean_scrub_stamp":"2026-02-18T03:25:32.324385+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:38:55.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"51'5","reported_seq":134,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:24.517152+0000","last_change":"2026-02-18T03:26:30.879182+0000","last_active":"2026-02-18T03:29:24.517152+0000","last_peered":"2026-02-18T03:29:24.517152+0000","last_clean":"2026-02-18T03:29:24.517152+0000","last_became_active":"2026-02-18T03:26:28.876319+0000","last_became_peered":"2026-02-18T03:26:28.876319+0000","last_unstale":"2026-02-18T03:29:24.517152+0000","last_undegraded":"2026-02-18T03:29:24.517152+0000","last_fullsized":"2026-02-18T03:29:24.517152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:17:14.358302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044052499999999999,"stat_sum":{"num_bytes":578,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":165,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"51'56","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.718215+0000","last_change":"2026-02-18T03:26:30.880009+0000","last_active":"2026-02-18T03:29:42.718215+0000","last_peered":"2026-02-18T03:29:42.718215+0000","last_clean":"2026-02-18T03:29:42.718215+0000","last_became_active":"2026-02-18T03:26:28.875638+0000","last_became_peered":"2026-02-18T03:26:28.875638+0000","last_unstale":"2026-02-18T03:29:42.718215+0000","last_undegraded":"2026-02-18T03:29:42.718215+0000","last_fullsized":"2026-02-18T03:29:42.718215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:40:48.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087564000000000001,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":658,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"51'165","reported_seq":970,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:47.702894+0000","last_change":"2026-02-18T03:26:30.879666+0000","last_active":"2026-02-18T03:29:47.702894+0000","last_peered":"2026-02-18T03:29:47.702894+0000","last_clean":"2026-02-18T03:29:47.702894+0000","last_became_active":"2026-02-18T03:26:28.876254+0000","last_became_peered":"2026-02-18T03:26:28.876254+0000","last_unstale":"2026-02-18T03:29:47.702894+0000","last_undegraded":"2026-02-18T03:29:47.702894+0000","last_fullsized":"2026-02-18T03:29:47.702894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:41:40.483727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000703147,"stat_sum":{"num_bytes":1092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1954,"num_read_kb":1744,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"51'218","reported_seq":1256,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:45.643637+0000","last_change":"2026-02-18T03:26:30.879339+0000","last_active":"2026-02-18T03:29:45.643637+0000","last_peered":"2026-02-18T03:29:45.643637+0000","last_clean":"2026-02-18T03:29:45.643637+0000","last_became_active":"2026-02-18T03:26:28.877153+0000","last_became_peered":"2026-02-18T03:26:28.877153+0000","last_unstale":"2026-02-18T03:29:45.643637+0000","last_undegraded":"2026-02-18T03:29:45.643637+0000","last_fullsized":"2026-02-18T03:29:45.643637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:45:37.834559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056595899999999999,"stat_sum":{"num_bytes":1092,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2602,"num_read_kb":2324,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"51'165","reported_seq":962,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.208262+0000","last_change":"2026-02-18T03:26:30.883336+0000","last_active":"2026-02-18T03:29:44.208262+0000","last_peered":"2026-02-18T03:29:44.208262+0000","last_clean":"2026-02-18T03:29:44.208262+0000","last_became_active":"2026-02-18T03:26:28.877762+0000","last_became_peered":"2026-02-18T03:26:28.877762+0000","last_unstale":"2026-02-18T03:29:44.208262+0000","last_undegraded":"2026-02-18T03:29:44.208262+0000","last_fullsized":"2026-02-18T03:29:44.208262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:47:06.825470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066703900000000002,"stat_sum":{"num_bytes":1092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1954,"num_read_kb":1744,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"51'53","reported_seq":346,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:43.501880+0000","last_change":"2026-02-18T03:26:30.928527+0000","last_active":"2026-02-18T03:29:43.501880+0000","last_peered":"2026-02-18T03:29:43.501880+0000","last_clean":"2026-02-18T03:29:43.501880+0000","last_became_active":"2026-02-18T03:26:28.876931+0000","last_became_peered":"2026-02-18T03:26:28.876931+0000","last_unstale":"2026-02-18T03:29:43.501880+0000","last_undegraded":"2026-02-18T03:29:43.501880+0000","last_fullsized":"2026-02-18T03:29:43.501880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:18:03.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038334300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":648,"num_read_kb":580,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.12","version":"51'161","reported_seq":1072,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.133688+0000","last_change":"2026-02-18T03:26:30.879650+0000","last_active":"2026-02-18T03:29:42.133688+0000","last_peered":"2026-02-18T03:29:42.133688+0000","last_clean":"2026-02-18T03:29:42.133688+0000","last_became_active":"2026-02-18T03:26:28.876862+0000","last_became_peered":"2026-02-18T03:26:28.876862+0000","last_unstale":"2026-02-18T03:29:42.133688+0000","last_undegraded":"2026-02-18T03:29:42.133688+0000","last_fullsized":"2026-02-18T03:29:42.133688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:37:48.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070632300000000002,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2104,"num_read_kb":1792,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"51'107","reported_seq":685,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.990774+0000","last_change":"2026-02-18T03:26:30.883415+0000","last_active":"2026-02-18T03:29:44.990774+0000","last_peered":"2026-02-18T03:29:44.990774+0000","last_clean":"2026-02-18T03:29:44.990774+0000","last_became_active":"2026-02-18T03:26:28.877661+0000","last_became_peered":"2026-02-18T03:26:28.877661+0000","last_unstale":"2026-02-18T03:29:44.990774+0000","last_undegraded":"2026-02-18T03:29:44.990774+0000","last_fullsized":"2026-02-18T03:29:44.990774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T10:02:54.128461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000612577,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1376,"num_read_kb":1186,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'60","reported_seq":550,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.301185+0000","last_change":"2026-02-18T03:26:30.879937+0000","last_active":"2026-02-18T03:29:44.301185+0000","last_peered":"2026-02-18T03:29:44.301185+0000","last_clean":"2026-02-18T03:29:44.301185+0000","last_became_active":"2026-02-18T03:26:28.877509+0000","last_became_peered":"2026-02-18T03:26:28.877509+0000","last_unstale":"2026-02-18T03:29:44.301185+0000","last_undegraded":"2026-02-18T03:29:44.301185+0000","last_fullsized":"2026-02-18T03:29:44.301185+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:35:29.852723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073327400000000001,"stat_sum":{"num_bytes":609,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":973,"num_read_kb":686,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'66","reported_seq":554,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.795196+0000","last_change":"2026-02-18T03:26:30.883870+0000","last_active":"2026-02-18T03:29:42.795196+0000","last_peered":"2026-02-18T03:29:42.795196+0000","last_clean":"2026-02-18T03:29:42.795196+0000","last_became_active":"2026-02-18T03:26:28.876542+0000","last_became_peered":"2026-02-18T03:26:28.876542+0000","last_unstale":"2026-02-18T03:29:42.795196+0000","last_undegraded":"2026-02-18T03:29:42.795196+0000","last_fullsized":"2026-02-18T03:29:42.795196+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:38:52.791544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083697700000000003,"stat_sum":{"num_bytes":1701,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":983,"num_read_kb":690,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3],"acting":[7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.16","version":"51'121","reported_seq":970,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:46.427730+0000","last_change":"2026-02-18T03:26:30.879645+0000","last_active":"2026-02-18T03:29:46.427730+0000","last_peered":"2026-02-18T03:29:46.427730+0000","last_clean":"2026-02-18T03:29:46.427730+0000","last_became_active":"2026-02-18T03:26:28.877030+0000","last_became_peered":"2026-02-18T03:26:28.877030+0000","last_unstale":"2026-02-18T03:29:46.427730+0000","last_undegraded":"2026-02-18T03:29:46.427730+0000","last_fullsized":"2026-02-18T03:29:46.427730+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:53:47.856194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044663100000000001,"stat_sum":{"num_bytes":1734,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1791,"num_read_kb":1322,"num_write":25,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"51'233","reported_seq":1431,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:43.426824+0000","last_change":"2026-02-18T03:26:30.928393+0000","last_active":"2026-02-18T03:29:43.426824+0000","last_peered":"2026-02-18T03:29:43.426824+0000","last_clean":"2026-02-18T03:29:43.426824+0000","last_became_active":"2026-02-18T03:26:28.876885+0000","last_became_peered":"2026-02-18T03:26:28.876885+0000","last_unstale":"2026-02-18T03:29:43.426824+0000","last_undegraded":"2026-02-18T03:29:43.426824+0000","last_fullsized":"2026-02-18T03:29:43.426824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:44:53.027527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027204600000000002,"stat_sum":{"num_bytes":3324,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2862,"num_read_kb":2410,"num_write":41,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"51'272","reported_seq":1656,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.908206+0000","last_change":"2026-02-18T03:26:30.879964+0000","last_active":"2026-02-18T03:29:42.908206+0000","last_peered":"2026-02-18T03:29:42.908206+0000","last_clean":"2026-02-18T03:29:42.908206+0000","last_became_active":"2026-02-18T03:26:28.876478+0000","last_became_peered":"2026-02-18T03:26:28.876478+0000","last_unstale":"2026-02-18T03:29:42.908206+0000","last_undegraded":"2026-02-18T03:29:42.908206+0000","last_fullsized":"2026-02-18T03:29:42.908206+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:22:19.632931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094043100000000004,"stat_sum":{"num_bytes":1108,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3330,"num_read_kb":2930,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"51'163","reported_seq":1015,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.990777+0000","last_change":"2026-02-18T03:26:30.928482+0000","last_active":"2026-02-18T03:29:44.990777+0000","last_peered":"2026-02-18T03:29:44.990777+0000","last_clean":"2026-02-18T03:29:44.990777+0000","last_became_active":"2026-02-18T03:26:28.876306+0000","last_became_peered":"2026-02-18T03:26:28.876306+0000","last_unstale":"2026-02-18T03:29:44.990777+0000","last_undegraded":"2026-02-18T03:29:44.990777+0000","last_fullsized":"2026-02-18T03:29:44.990777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:34:35.072706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026575399999999999,"stat_sum":{"num_bytes":562,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2029,"num_read_kb":1768,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"51'14","reported_seq":2053,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:27.365832+0000","last_change":"2026-02-18T03:26:30.881941+0000","last_active":"2026-02-18T03:29:27.365832+0000","last_peered":"2026-02-18T03:29:27.365832+0000","last_clean":"2026-02-18T03:29:27.365832+0000","last_became_active":"2026-02-18T03:26:28.875649+0000","last_became_peered":"2026-02-18T03:26:28.875649+0000","last_unstale":"2026-02-18T03:29:27.365832+0000","last_undegraded":"2026-02-18T03:29:27.365832+0000","last_fullsized":"2026-02-18T03:29:27.365832+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T13:34:12.898823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010449439999999999,"stat_sum":{"num_bytes":1704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2111,"num_read_kb":1940,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"51'164","reported_seq":1056,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.795248+0000","last_change":"2026-02-18T03:26:30.879736+0000","last_active":"2026-02-18T03:29:42.795248+0000","last_peered":"2026-02-18T03:29:42.795248+0000","last_clean":"2026-02-18T03:29:42.795248+0000","last_became_active":"2026-02-18T03:26:28.876640+0000","last_became_peered":"2026-02-18T03:26:28.876640+0000","last_unstale":"2026-02-18T03:29:42.795248+0000","last_undegraded":"2026-02-18T03:29:42.795248+0000","last_fullsized":"2026-02-18T03:29:42.795248+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T13:38:47.109205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068118599999999997,"stat_sum":{"num_bytes":578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2109,"num_read_kb":1794,"num_write":20,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":35982,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":54920,"num_read_kb":77972,"num_write":3975,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":107946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":374577,"internal_metadata":0},"log_size":8162,"ondisk_log_size":8162,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":45,"seq":193273528366,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":70,"kb_used_meta":26873,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":236554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71710,"internal_metadata":27518946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27600,"kb_used_data":636,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975600,"statfs":{"total":751619276800,"available":751591014400,"internally_reserved":0,"allocated":651264,"data_stored":225859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28951,"internal_metadata":27561705},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28264,"kb_used_data":1300,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733974936,"statfs":{"total":751619276800,"available":751590334464,"internally_reserved":0,"allocated":1331200,"data_stored":820806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38382,"internal_metadata":27552274},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051634,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27580,"kb_used_data":616,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975620,"statfs":{"total":751619276800,"available":751591034880,"internally_reserved":0,"allocated":630784,"data_stored":226841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31060,"internal_metadata":27559596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280564,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28320,"kb_used_data":1356,"kb_used_omap":99,"kb_used_meta":26844,"kb_avail":733974880,"statfs":{"total":751619276800,"available":751590277120,"internally_reserved":0,"allocated":1388544,"data_stored":824208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":101700,"internal_metadata":27488956},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28184,"kb_used_data":1220,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975016,"statfs":{"total":751619276800,"available":751590416384,"internally_reserved":0,"allocated":1249280,"data_stored":815184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40538,"internal_metadata":27550118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607608,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":80,"kb_used_meta":26863,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82004,"internal_metadata":27508652},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27580,"kb_used_data":616,"kb_used_omap":40,"kb_used_meta":26903,"kb_avail":733975620,"statfs":{"total":751619276800,"available":751591034880,"internally_reserved":0,"allocated":630784,"data_stored":224721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41735,"internal_metadata":27548921},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":8960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24264,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":15204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74026,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36315,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":18079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":90303,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24714,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":14677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30838,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27358,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":20793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66759,"internal_metadata":0}]}} 2026-02-18T03:29:48.435 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.86:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.86:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 136 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:29:48.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:29:48.632 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:29:48.633 INFO:teuthology.orchestra.run.trial034.stderr:dumped all 2026-02-18T03:29:48.644 INFO:teuthology.orchestra.run.trial034.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-18T03:29:47.853577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":626350,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":55016,"num_read_kb":78054,"num_write":4142,"num_write_kb":3901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8294,"ondisk_log_size":8294,"up":99,"acting":99,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":5872025600,"kb_used":222968,"kb_used_data":7256,"kb_used_omap":425,"kb_used_meta":215126,"kb_avail":5871802632,"statfs":{"total":6012954214400,"available":6012725895168,"internally_reserved":0,"allocated":7430144,"data_stored":3605138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":436080,"internal_metadata":220289168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":1910,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001921"},"pg_stats":[{"pgid":"2.1f","version":"51'276","reported_seq":1654,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:45.074457+0000","last_change":"2026-02-18T03:26:30.928476+0000","last_active":"2026-02-18T03:29:45.074457+0000","last_peered":"2026-02-18T03:29:45.074457+0000","last_clean":"2026-02-18T03:29:45.074457+0000","last_became_active":"2026-02-18T03:26:28.875098+0000","last_became_peered":"2026-02-18T03:26:28.875098+0000","last_unstale":"2026-02-18T03:29:45.074457+0000","last_undegraded":"2026-02-18T03:29:45.074457+0000","last_fullsized":"2026-02-18T03:29:45.074457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:21:52.320628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027300700000000002,"stat_sum":{"num_bytes":1670,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3415,"num_read_kb":2958,"num_write":36,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"51'60","reported_seq":551,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.908231+0000","last_change":"2026-02-18T03:26:30.879720+0000","last_active":"2026-02-18T03:29:42.908231+0000","last_peered":"2026-02-18T03:29:42.908231+0000","last_clean":"2026-02-18T03:29:42.908231+0000","last_became_active":"2026-02-18T03:26:28.875687+0000","last_became_peered":"2026-02-18T03:26:28.875687+0000","last_unstale":"2026-02-18T03:29:42.908231+0000","last_undegraded":"2026-02-18T03:29:42.908231+0000","last_fullsized":"2026-02-18T03:29:42.908231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:02:43.573409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076759699999999996,"stat_sum":{"num_bytes":610,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":973,"num_read_kb":686,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"51'14","reported_seq":301,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:19.552105+0000","last_change":"2026-02-18T03:26:30.883566+0000","last_active":"2026-02-18T03:29:19.552105+0000","last_peered":"2026-02-18T03:29:19.552105+0000","last_clean":"2026-02-18T03:29:19.552105+0000","last_became_active":"2026-02-18T03:26:28.877036+0000","last_became_peered":"2026-02-18T03:26:28.877036+0000","last_unstale":"2026-02-18T03:29:19.552105+0000","last_undegraded":"2026-02-18T03:29:19.552105+0000","last_fullsized":"2026-02-18T03:29:19.552105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:14:34.096416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064737200000000001,"stat_sum":{"num_bytes":1717,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":415,"num_read_kb":136,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1c","version":"51'125","reported_seq":577,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:41.364201+0000","last_change":"2026-02-18T03:26:30.883647+0000","last_active":"2026-02-18T03:29:41.364201+0000","last_peered":"2026-02-18T03:29:41.364201+0000","last_clean":"2026-02-18T03:29:41.364201+0000","last_became_active":"2026-02-18T03:26:28.876499+0000","last_became_peered":"2026-02-18T03:26:28.876499+0000","last_unstale":"2026-02-18T03:29:41.364201+0000","last_undegraded":"2026-02-18T03:29:41.364201+0000","last_fullsized":"2026-02-18T03:29:41.364201+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:07:58.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068141600000000001,"stat_sum":{"num_bytes":1124,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":946,"num_read_kb":764,"num_write":77,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"51'162","reported_seq":919,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.931244+0000","last_change":"2026-02-18T03:26:30.883793+0000","last_active":"2026-02-18T03:29:44.931244+0000","last_peered":"2026-02-18T03:29:44.931244+0000","last_clean":"2026-02-18T03:29:44.931244+0000","last_became_active":"2026-02-18T03:26:28.876720+0000","last_became_peered":"2026-02-18T03:26:28.876720+0000","last_unstale":"2026-02-18T03:29:44.931244+0000","last_undegraded":"2026-02-18T03:29:44.931244+0000","last_fullsized":"2026-02-18T03:29:44.931244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:59:06.734438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842399999999997,"stat_sum":{"num_bytes":546,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1949,"num_read_kb":1742,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"51'169","reported_seq":1008,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.920215+0000","last_change":"2026-02-18T03:26:30.879103+0000","last_active":"2026-02-18T03:29:44.920215+0000","last_peered":"2026-02-18T03:29:44.920215+0000","last_clean":"2026-02-18T03:29:44.920215+0000","last_became_active":"2026-02-18T03:26:28.876480+0000","last_became_peered":"2026-02-18T03:26:28.876480+0000","last_unstale":"2026-02-18T03:29:44.920215+0000","last_undegraded":"2026-02-18T03:29:44.920215+0000","last_fullsized":"2026-02-18T03:29:44.920215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:04:51.993586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041648,"stat_sum":{"num_bytes":1654,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2039,"num_read_kb":1772,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.9","version":"51'59","reported_seq":346,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:47.719266+0000","last_change":"2026-02-18T03:26:30.879397+0000","last_active":"2026-02-18T03:29:47.719266+0000","last_peered":"2026-02-18T03:29:47.719266+0000","last_clean":"2026-02-18T03:29:47.719266+0000","last_became_active":"2026-02-18T03:26:28.876498+0000","last_became_peered":"2026-02-18T03:26:28.876498+0000","last_unstale":"2026-02-18T03:29:47.719266+0000","last_undegraded":"2026-02-18T03:29:47.719266+0000","last_fullsized":"2026-02-18T03:29:47.719266+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:43:40.090906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071128100000000002,"stat_sum":{"num_bytes":1092,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":658,"num_read_kb":584,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"51'173","reported_seq":1088,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.121897+0000","last_change":"2026-02-18T03:26:30.881303+0000","last_active":"2026-02-18T03:29:44.121897+0000","last_peered":"2026-02-18T03:29:44.121897+0000","last_clean":"2026-02-18T03:29:44.121897+0000","last_became_active":"2026-02-18T03:26:28.875318+0000","last_became_peered":"2026-02-18T03:26:28.875318+0000","last_unstale":"2026-02-18T03:29:44.121897+0000","last_undegraded":"2026-02-18T03:29:44.121897+0000","last_fullsized":"2026-02-18T03:29:44.121897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:53:58.504617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067144800000000005,"stat_sum":{"num_bytes":2216,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2124,"num_read_kb":1800,"num_write":29,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"51'4557","reported_seq":9718,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.920682+0000","last_change":"2026-02-18T03:26:30.882045+0000","last_active":"2026-02-18T03:29:44.920682+0000","last_peered":"2026-02-18T03:29:44.920682+0000","last_clean":"2026-02-18T03:29:44.920682+0000","last_became_active":"2026-02-18T03:26:28.875365+0000","last_became_peered":"2026-02-18T03:26:28.875365+0000","last_unstale":"2026-02-18T03:29:44.920682+0000","last_undegraded":"2026-02-18T03:29:44.920682+0000","last_fullsized":"2026-02-18T03:29:44.920682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":4557,"log_dups_size":0,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:25:15.111389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072736299999999997,"stat_sum":{"num_bytes":562,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7405,"num_read_kb":38264,"num_write":3347,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'110","reported_seq":880,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:46.385246+0000","last_change":"2026-02-18T03:26:30.879819+0000","last_active":"2026-02-18T03:29:46.385246+0000","last_peered":"2026-02-18T03:29:46.385246+0000","last_clean":"2026-02-18T03:29:46.385246+0000","last_became_active":"2026-02-18T03:26:28.876556+0000","last_became_peered":"2026-02-18T03:26:28.876556+0000","last_unstale":"2026-02-18T03:29:46.385246+0000","last_undegraded":"2026-02-18T03:29:46.385246+0000","last_fullsized":"2026-02-18T03:29:46.385246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:26:39.338389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062329799999999999,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1616,"num_read_kb":1264,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'61","reported_seq":460,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.085234+0000","last_change":"2026-02-18T03:26:30.884004+0000","last_active":"2026-02-18T03:29:42.085234+0000","last_peered":"2026-02-18T03:29:42.085234+0000","last_clean":"2026-02-18T03:29:42.085234+0000","last_became_active":"2026-02-18T03:26:28.876686+0000","last_became_peered":"2026-02-18T03:26:28.876686+0000","last_unstale":"2026-02-18T03:29:42.085234+0000","last_undegraded":"2026-02-18T03:29:42.085234+0000","last_fullsized":"2026-02-18T03:29:42.085234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:22:28.566145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000711452,"stat_sum":{"num_bytes":1124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":818,"num_read_kb":636,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"51'12","reported_seq":195,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:20.251925+0000","last_change":"2026-02-18T03:26:30.879415+0000","last_active":"2026-02-18T03:29:20.251925+0000","last_peered":"2026-02-18T03:29:20.251925+0000","last_clean":"2026-02-18T03:29:20.251925+0000","last_became_active":"2026-02-18T03:26:28.875226+0000","last_became_peered":"2026-02-18T03:26:28.875226+0000","last_unstale":"2026-02-18T03:29:20.251925+0000","last_undegraded":"2026-02-18T03:29:20.251925+0000","last_fullsized":"2026-02-18T03:29:20.251925+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:30:16.188284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051818299999999997,"stat_sum":{"num_bytes":1686,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":84,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"51'115","reported_seq":808,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.923201+0000","last_change":"2026-02-18T03:26:30.881557+0000","last_active":"2026-02-18T03:29:44.923201+0000","last_peered":"2026-02-18T03:29:44.923201+0000","last_clean":"2026-02-18T03:29:44.923201+0000","last_became_active":"2026-02-18T03:26:28.876788+0000","last_became_peered":"2026-02-18T03:26:28.876788+0000","last_unstale":"2026-02-18T03:29:44.923201+0000","last_undegraded":"2026-02-18T03:29:44.923201+0000","last_fullsized":"2026-02-18T03:29:44.923201+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:43:22.679175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069877000000000003,"stat_sum":{"num_bytes":1140,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1546,"num_read_kb":1242,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"51'113","reported_seq":705,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.208204+0000","last_change":"2026-02-18T03:26:30.879654+0000","last_active":"2026-02-18T03:29:44.208204+0000","last_peered":"2026-02-18T03:29:44.208204+0000","last_clean":"2026-02-18T03:29:44.208204+0000","last_became_active":"2026-02-18T03:26:28.876707+0000","last_became_peered":"2026-02-18T03:26:28.876707+0000","last_unstale":"2026-02-18T03:29:44.208204+0000","last_undegraded":"2026-02-18T03:29:44.208204+0000","last_fullsized":"2026-02-18T03:29:44.208204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:23:52.206647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054380100000000001,"stat_sum":{"num_bytes":1108,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1386,"num_read_kb":1190,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"51'63","reported_seq":399,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.853689+0000","last_change":"2026-02-18T03:26:30.881372+0000","last_active":"2026-02-18T03:29:44.853689+0000","last_peered":"2026-02-18T03:29:44.853689+0000","last_clean":"2026-02-18T03:29:44.853689+0000","last_became_active":"2026-02-18T03:26:28.876802+0000","last_became_peered":"2026-02-18T03:26:28.876802+0000","last_unstale":"2026-02-18T03:29:44.853689+0000","last_undegraded":"2026-02-18T03:29:44.853689+0000","last_fullsized":"2026-02-18T03:29:44.853689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:46:08.030977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067318200000000003,"stat_sum":{"num_bytes":1654,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":743,"num_read_kb":612,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'70","reported_seq":412,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:39.914776+0000","last_change":"2026-02-18T03:26:30.928383+0000","last_active":"2026-02-18T03:29:39.914776+0000","last_peered":"2026-02-18T03:29:39.914776+0000","last_clean":"2026-02-18T03:29:39.914776+0000","last_became_active":"2026-02-18T03:26:28.877382+0000","last_became_peered":"2026-02-18T03:26:28.877382+0000","last_unstale":"2026-02-18T03:29:39.914776+0000","last_undegraded":"2026-02-18T03:29:39.914776+0000","last_fullsized":"2026-02-18T03:29:39.914776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:39:28.158951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026359000000000002,"stat_sum":{"num_bytes":2746,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":753,"num_read_kb":616,"num_write":21,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'132","reported_seq":251,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:27:45.093119+0000","last_change":"2026-02-18T03:26:00.249543+0000","last_active":"2026-02-18T03:27:45.093119+0000","last_peered":"2026-02-18T03:27:45.093119+0000","last_clean":"2026-02-18T03:27:45.093119+0000","last_became_active":"2026-02-18T03:26:00.249296+0000","last_became_peered":"2026-02-18T03:26:00.249296+0000","last_unstale":"2026-02-18T03:27:45.093119+0000","last_undegraded":"2026-02-18T03:27:45.093119+0000","last_fullsized":"2026-02-18T03:27:45.093119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:25:32.324385+0000","last_clean_scrub_stamp":"2026-02-18T03:25:32.324385+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:38:55.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"51'5","reported_seq":134,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:24.517152+0000","last_change":"2026-02-18T03:26:30.879182+0000","last_active":"2026-02-18T03:29:24.517152+0000","last_peered":"2026-02-18T03:29:24.517152+0000","last_clean":"2026-02-18T03:29:24.517152+0000","last_became_active":"2026-02-18T03:26:28.876319+0000","last_became_peered":"2026-02-18T03:26:28.876319+0000","last_unstale":"2026-02-18T03:29:24.517152+0000","last_undegraded":"2026-02-18T03:29:24.517152+0000","last_fullsized":"2026-02-18T03:29:24.517152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:17:14.358302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044052499999999999,"stat_sum":{"num_bytes":578,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":165,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"51'56","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.718215+0000","last_change":"2026-02-18T03:26:30.880009+0000","last_active":"2026-02-18T03:29:42.718215+0000","last_peered":"2026-02-18T03:29:42.718215+0000","last_clean":"2026-02-18T03:29:42.718215+0000","last_became_active":"2026-02-18T03:26:28.875638+0000","last_became_peered":"2026-02-18T03:26:28.875638+0000","last_unstale":"2026-02-18T03:29:42.718215+0000","last_undegraded":"2026-02-18T03:29:42.718215+0000","last_fullsized":"2026-02-18T03:29:42.718215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:40:48.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087564000000000001,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":658,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"51'165","reported_seq":970,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:47.702894+0000","last_change":"2026-02-18T03:26:30.879666+0000","last_active":"2026-02-18T03:29:47.702894+0000","last_peered":"2026-02-18T03:29:47.702894+0000","last_clean":"2026-02-18T03:29:47.702894+0000","last_became_active":"2026-02-18T03:26:28.876254+0000","last_became_peered":"2026-02-18T03:26:28.876254+0000","last_unstale":"2026-02-18T03:29:47.702894+0000","last_undegraded":"2026-02-18T03:29:47.702894+0000","last_fullsized":"2026-02-18T03:29:47.702894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:41:40.483727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000703147,"stat_sum":{"num_bytes":1092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1954,"num_read_kb":1744,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"51'218","reported_seq":1256,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:45.643637+0000","last_change":"2026-02-18T03:26:30.879339+0000","last_active":"2026-02-18T03:29:45.643637+0000","last_peered":"2026-02-18T03:29:45.643637+0000","last_clean":"2026-02-18T03:29:45.643637+0000","last_became_active":"2026-02-18T03:26:28.877153+0000","last_became_peered":"2026-02-18T03:26:28.877153+0000","last_unstale":"2026-02-18T03:29:45.643637+0000","last_undegraded":"2026-02-18T03:29:45.643637+0000","last_fullsized":"2026-02-18T03:29:45.643637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:45:37.834559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056595899999999999,"stat_sum":{"num_bytes":1092,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2602,"num_read_kb":2324,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"51'165","reported_seq":962,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.208262+0000","last_change":"2026-02-18T03:26:30.883336+0000","last_active":"2026-02-18T03:29:44.208262+0000","last_peered":"2026-02-18T03:29:44.208262+0000","last_clean":"2026-02-18T03:29:44.208262+0000","last_became_active":"2026-02-18T03:26:28.877762+0000","last_became_peered":"2026-02-18T03:26:28.877762+0000","last_unstale":"2026-02-18T03:29:44.208262+0000","last_undegraded":"2026-02-18T03:29:44.208262+0000","last_fullsized":"2026-02-18T03:29:44.208262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:47:06.825470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066703900000000002,"stat_sum":{"num_bytes":1092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1954,"num_read_kb":1744,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"51'53","reported_seq":346,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:43.501880+0000","last_change":"2026-02-18T03:26:30.928527+0000","last_active":"2026-02-18T03:29:43.501880+0000","last_peered":"2026-02-18T03:29:43.501880+0000","last_clean":"2026-02-18T03:29:43.501880+0000","last_became_active":"2026-02-18T03:26:28.876931+0000","last_became_peered":"2026-02-18T03:26:28.876931+0000","last_unstale":"2026-02-18T03:29:43.501880+0000","last_undegraded":"2026-02-18T03:29:43.501880+0000","last_fullsized":"2026-02-18T03:29:43.501880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:18:03.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038334300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":648,"num_read_kb":580,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.12","version":"51'161","reported_seq":1072,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.133688+0000","last_change":"2026-02-18T03:26:30.879650+0000","last_active":"2026-02-18T03:29:42.133688+0000","last_peered":"2026-02-18T03:29:42.133688+0000","last_clean":"2026-02-18T03:29:42.133688+0000","last_became_active":"2026-02-18T03:26:28.876862+0000","last_became_peered":"2026-02-18T03:26:28.876862+0000","last_unstale":"2026-02-18T03:29:42.133688+0000","last_undegraded":"2026-02-18T03:29:42.133688+0000","last_fullsized":"2026-02-18T03:29:42.133688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:37:48.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070632300000000002,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2104,"num_read_kb":1792,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"51'107","reported_seq":685,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.990774+0000","last_change":"2026-02-18T03:26:30.883415+0000","last_active":"2026-02-18T03:29:44.990774+0000","last_peered":"2026-02-18T03:29:44.990774+0000","last_clean":"2026-02-18T03:29:44.990774+0000","last_became_active":"2026-02-18T03:26:28.877661+0000","last_became_peered":"2026-02-18T03:26:28.877661+0000","last_unstale":"2026-02-18T03:29:44.990774+0000","last_undegraded":"2026-02-18T03:29:44.990774+0000","last_fullsized":"2026-02-18T03:29:44.990774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T10:02:54.128461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000612577,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1376,"num_read_kb":1186,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'60","reported_seq":550,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.301185+0000","last_change":"2026-02-18T03:26:30.879937+0000","last_active":"2026-02-18T03:29:44.301185+0000","last_peered":"2026-02-18T03:29:44.301185+0000","last_clean":"2026-02-18T03:29:44.301185+0000","last_became_active":"2026-02-18T03:26:28.877509+0000","last_became_peered":"2026-02-18T03:26:28.877509+0000","last_unstale":"2026-02-18T03:29:44.301185+0000","last_undegraded":"2026-02-18T03:29:44.301185+0000","last_fullsized":"2026-02-18T03:29:44.301185+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:35:29.852723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073327400000000001,"stat_sum":{"num_bytes":609,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":973,"num_read_kb":686,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'66","reported_seq":554,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.795196+0000","last_change":"2026-02-18T03:26:30.883870+0000","last_active":"2026-02-18T03:29:42.795196+0000","last_peered":"2026-02-18T03:29:42.795196+0000","last_clean":"2026-02-18T03:29:42.795196+0000","last_became_active":"2026-02-18T03:26:28.876542+0000","last_became_peered":"2026-02-18T03:26:28.876542+0000","last_unstale":"2026-02-18T03:29:42.795196+0000","last_undegraded":"2026-02-18T03:29:42.795196+0000","last_fullsized":"2026-02-18T03:29:42.795196+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T12:38:52.791544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083697700000000003,"stat_sum":{"num_bytes":1701,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":983,"num_read_kb":690,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3],"acting":[7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.16","version":"51'121","reported_seq":970,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:46.427730+0000","last_change":"2026-02-18T03:26:30.879645+0000","last_active":"2026-02-18T03:29:46.427730+0000","last_peered":"2026-02-18T03:29:46.427730+0000","last_clean":"2026-02-18T03:29:46.427730+0000","last_became_active":"2026-02-18T03:26:28.877030+0000","last_became_peered":"2026-02-18T03:26:28.877030+0000","last_unstale":"2026-02-18T03:29:46.427730+0000","last_undegraded":"2026-02-18T03:29:46.427730+0000","last_fullsized":"2026-02-18T03:29:46.427730+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:53:47.856194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044663100000000001,"stat_sum":{"num_bytes":1734,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1791,"num_read_kb":1322,"num_write":25,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"51'233","reported_seq":1431,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:43.426824+0000","last_change":"2026-02-18T03:26:30.928393+0000","last_active":"2026-02-18T03:29:43.426824+0000","last_peered":"2026-02-18T03:29:43.426824+0000","last_clean":"2026-02-18T03:29:43.426824+0000","last_became_active":"2026-02-18T03:26:28.876885+0000","last_became_peered":"2026-02-18T03:26:28.876885+0000","last_unstale":"2026-02-18T03:29:43.426824+0000","last_undegraded":"2026-02-18T03:29:43.426824+0000","last_fullsized":"2026-02-18T03:29:43.426824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T14:44:53.027527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027204600000000002,"stat_sum":{"num_bytes":3324,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2862,"num_read_kb":2410,"num_write":41,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"51'272","reported_seq":1656,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.908206+0000","last_change":"2026-02-18T03:26:30.879964+0000","last_active":"2026-02-18T03:29:42.908206+0000","last_peered":"2026-02-18T03:29:42.908206+0000","last_clean":"2026-02-18T03:29:42.908206+0000","last_became_active":"2026-02-18T03:26:28.876478+0000","last_became_peered":"2026-02-18T03:26:28.876478+0000","last_unstale":"2026-02-18T03:29:42.908206+0000","last_undegraded":"2026-02-18T03:29:42.908206+0000","last_fullsized":"2026-02-18T03:29:42.908206+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T11:22:19.632931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094043100000000004,"stat_sum":{"num_bytes":1108,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3330,"num_read_kb":2930,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"51'163","reported_seq":1015,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:44.990777+0000","last_change":"2026-02-18T03:26:30.928482+0000","last_active":"2026-02-18T03:29:44.990777+0000","last_peered":"2026-02-18T03:29:44.990777+0000","last_clean":"2026-02-18T03:29:44.990777+0000","last_became_active":"2026-02-18T03:26:28.876306+0000","last_became_peered":"2026-02-18T03:26:28.876306+0000","last_unstale":"2026-02-18T03:29:44.990777+0000","last_undegraded":"2026-02-18T03:29:44.990777+0000","last_fullsized":"2026-02-18T03:29:44.990777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:34:35.072706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026575399999999999,"stat_sum":{"num_bytes":562,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2029,"num_read_kb":1768,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"51'14","reported_seq":2053,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:27.365832+0000","last_change":"2026-02-18T03:26:30.881941+0000","last_active":"2026-02-18T03:29:27.365832+0000","last_peered":"2026-02-18T03:29:27.365832+0000","last_clean":"2026-02-18T03:29:27.365832+0000","last_became_active":"2026-02-18T03:26:28.875649+0000","last_became_peered":"2026-02-18T03:26:28.875649+0000","last_unstale":"2026-02-18T03:29:27.365832+0000","last_undegraded":"2026-02-18T03:29:27.365832+0000","last_fullsized":"2026-02-18T03:29:27.365832+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T13:34:12.898823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010449439999999999,"stat_sum":{"num_bytes":1704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2111,"num_read_kb":1940,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"51'164","reported_seq":1056,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-18T03:29:42.795248+0000","last_change":"2026-02-18T03:26:30.879736+0000","last_active":"2026-02-18T03:29:42.795248+0000","last_peered":"2026-02-18T03:29:42.795248+0000","last_clean":"2026-02-18T03:29:42.795248+0000","last_became_active":"2026-02-18T03:26:28.876640+0000","last_became_peered":"2026-02-18T03:26:28.876640+0000","last_unstale":"2026-02-18T03:29:42.795248+0000","last_undegraded":"2026-02-18T03:29:42.795248+0000","last_fullsized":"2026-02-18T03:29:42.795248+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T03:26:27.864046+0000","last_clean_scrub_stamp":"2026-02-18T03:26:27.864046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T13:38:47.109205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068118599999999997,"stat_sum":{"num_bytes":578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2109,"num_read_kb":1794,"num_write":20,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":35982,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":54920,"num_read_kb":77972,"num_write":3975,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":107946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":374577,"internal_metadata":0},"log_size":8162,"ondisk_log_size":8162,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":45,"seq":193273528366,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":70,"kb_used_meta":26873,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":236554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71710,"internal_metadata":27518946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27600,"kb_used_data":636,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975600,"statfs":{"total":751619276800,"available":751591014400,"internally_reserved":0,"allocated":651264,"data_stored":225859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28951,"internal_metadata":27561705},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28264,"kb_used_data":1300,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733974936,"statfs":{"total":751619276800,"available":751590334464,"internally_reserved":0,"allocated":1331200,"data_stored":820806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38382,"internal_metadata":27552274},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051634,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27580,"kb_used_data":616,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975620,"statfs":{"total":751619276800,"available":751591034880,"internally_reserved":0,"allocated":630784,"data_stored":226841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31060,"internal_metadata":27559596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280564,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28320,"kb_used_data":1356,"kb_used_omap":99,"kb_used_meta":26844,"kb_avail":733974880,"statfs":{"total":751619276800,"available":751590277120,"internally_reserved":0,"allocated":1388544,"data_stored":824208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":101700,"internal_metadata":27488956},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28184,"kb_used_data":1220,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975016,"statfs":{"total":751619276800,"available":751590416384,"internally_reserved":0,"allocated":1249280,"data_stored":815184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40538,"internal_metadata":27550118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607608,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":80,"kb_used_meta":26863,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82004,"internal_metadata":27508652},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27580,"kb_used_data":616,"kb_used_omap":40,"kb_used_meta":26903,"kb_avail":733975620,"statfs":{"total":751619276800,"available":751591034880,"internally_reserved":0,"allocated":630784,"data_stored":224721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41735,"internal_metadata":27548921},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":8960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24264,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":15204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74026,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":9055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36315,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":18079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":90303,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":11080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24714,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":14677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30838,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":10098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27358,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":20793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66759,"internal_metadata":0}]}} 2026-02-18T03:29:48.647 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-18T03:29:48.647 DEBUG:tasks.mon_thrash:Yielding 2026-02-18T03:29:48.647 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T03:29:48.663 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:29:48.663 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T03:29:48.664 DEBUG:teuthology.orchestra.run.trial014:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:29:48.664 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:start thrashing 2026-02-18T03:29:48.664 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:seed: 1771385388, revive delay: 60.0, thrash delay: 60.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-18T03:29:48.664 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:29:48.665 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:29:48.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T03:29:48.683 INFO:teuthology.orchestra.run.trial014.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T03:29:48.683 DEBUG:teuthology.orchestra.run.trial014:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:29:48.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:29:48.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:29:48.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 84 2026-02-18T03:29:48.687 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO state.py:1126 (84): Cleanup OMAP on exit (discovery-trial034) 2026-02-18T03:29:48.739 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T03:29:48.739 DEBUG:teuthology.orchestra.run.trial014:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T03:29:48.795 INFO:tasks.workunit:timeout=60m 2026-02-18T03:29:48.796 INFO:tasks.workunit:cleanup=True 2026-02-18T03:29:48.796 DEBUG:teuthology.orchestra.run.trial014:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:29:48.852 INFO:tasks.workunit.client.0.trial014.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T03:29:48.895 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":290,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:29:48.908 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:29:48.908 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:29:48.908 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:29:48.909 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: pgmap v200: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 159 KiB/s rd, 0 B/s wr, 16 op/s 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='client.32025 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3537537716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3549492441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "mypool", "var": "pg_num"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3883873760' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:29:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:29:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:29:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 podman[79365]: 2026-02-18 03:29:48.789687652 +0000 UTC m=+0.609698450 container died b5ceeeca2d24004572f04b71e104deced54bb98701a62e8926fa751e576fa6ed (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.buildah.version=1.29.0, io.ceph.git.branch=devel, io.openshift.wants=ceph,rbd, io.ceph.nvmeof=, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.spdk.build.target-arch=x86-64-v2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, distribution-scope=public, io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=, io.spdk.version=25.09, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, architecture=x86_64, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.ceph.component=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-type=git, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers ) 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 podman[79365]: 2026-02-18 03:29:48.802589103 +0000 UTC m=+0.622599901 container remove b5ceeeca2d24004572f04b71e104deced54bb98701a62e8926fa751e576fa6ed (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.summary=Ceph NVMe over Fabrics Gateway, version=1.6.5, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, io.spdk.build.makeflags=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.spdk.build.target-arch=x86-64-v2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, release=, vcs-type=git, com.redhat.component=ubi9-container, io.ceph.nvmeof=, io.spdk.git.branch=undefined, io.openshift.wants=ceph,rbd, distribution-scope=public, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.version=25.09, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0) 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 bash[79365]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:29:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 11min 30.825s CPU time. 2026-02-18T03:29:49.023 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:29:49.023 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:29:49.023 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 14, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 338449, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 290, 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.024 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:29:49.025 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.026 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.027 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "num": 28 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:29:49.028 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:29:49.029 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:29:49.029 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:29:49.029 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 141 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO state.py:1126 (141): Cleanup OMAP on exit (discovery-trial086) 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[50939]: [18-Feb-2026 03:29:48] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 podman[61927]: 2026-02-18 03:29:48.914242977 +0000 UTC m=+0.612119329 container died 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, architecture=x86_64, build-date=2026-02-11 09:53:49 UTC, io.ceph.version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, io.spdk.build.ceph-release=20.2.0, version=1.6.5, com.redhat.component=ubi9-container, io.spdk.git.branch=undefined, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.component=ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.buildah.version=1.29.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.wants=ceph,rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, maintainer=Ceph Developers , vendor=Red Hat, Inc., name=ceph-nvmeof, io.spdk.version=25.09, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, distribution-scope=public, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 podman[61927]: 2026-02-18 03:29:48.926947919 +0000 UTC m=+0.624824281 container remove 0b0204fac9b0df0a906f840e1e45611e3716875a092951f21a84a0445d61451a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.ceph-release=20.2.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.component=ceph-nvmeof, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, org.centos.version=9.0-30.el9, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-type=git, build-date=2026-02-11 09:53:49 UTC, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.nvmeof=, version=1.6.5, vendor=Red Hat, Inc., io.spdk.build.pkgdep-args=--rbd, io.buildah.version=1.29.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , io.spdk.git.branch=undefined, io.ceph.git.branch=devel, url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.wants=ceph,rbd, distribution-scope=public, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:48 trial086 bash[61927]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:29:49.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 11min 22.909s CPU time, 1.5G memory peak. 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: pgmap v200: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 159 KiB/s rd, 0 B/s wr, 16 op/s 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='client.32025 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3537537716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3549492441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "mypool", "var": "pg_num"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:49.070 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:48 trial086 ceph-mon[24100]: from='client.? 10.20.193.34:0/3883873760' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:29:49.151 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:29:49.151 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:29:49.151 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 14, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 299933, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 290, 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.152 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.153 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:29:49.155 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:29:49.158 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:29:49.158 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:29:49.158 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: pgmap v200: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 159 KiB/s rd, 0 B/s wr, 16 op/s 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='client.32025 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3537537716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3549492441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "mypool", "var": "pg_num"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:29:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:29:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3883873760' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 14, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 301247, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 290, 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.236 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:29:49.237 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.239 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "num": 44 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:29:49.240 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:29:49.242 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:29:49.242 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['b'] 2026-02-18T03:29:49.242 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:29:49.242 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.b 2026-02-18T03:29:49.242 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.b 2026-02-18T03:29:49.242 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-18T03:29:49.243 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b 2026-02-18T03:29:49.495 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service' 2026-02-18T03:29:49.516 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: Stopping Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:29:49.516 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[24096]: 2026-02-18T03:29:49.336+0000 7fc34a315640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:29:49.516 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[24096]: 2026-02-18T03:29:49.336+0000 7fc34a315640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 podman[62104]: 2026-02-18 03:29:49.407621219 +0000 UTC m=+0.083545468 container died b72580359e58a02c38bd2c1f20a53a45d1166fc46e6d00e2a965e2c360b31715 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 podman[62104]: 2026-02-18 03:29:49.417839548 +0000 UTC m=+0.093763807 container remove b72580359e58a02c38bd2c1f20a53a45d1166fc46e6d00e2a965e2c360b31715 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216) 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 bash[62104]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service: Deactivated successfully. 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: Stopped Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:29:49.517 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:29:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service: Consumed 4.375s CPU time. 2026-02-18T03:29:49.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:29:49.532 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-18T03:29:49.532 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:29:49.532 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:29:49.759 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":291,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:29:52.770 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:29:52.993 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":294,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:29:56.003 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:29:56.226 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":297,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:29:59.236 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:30:05.211 INFO:teuthology.orchestra.run.trial086.stdout:Removed nvmeof.nvmeof.b from host 'trial086' 2026-02-18T03:30:05.221 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.c 2026-02-18T03:30:05.221 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon rm nvmeof.nvmeof.c 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:04 trial086 systemd[1]: Starting Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 podman[62425]: 2026-02-18 03:30:05.037882226 +0000 UTC m=+0.018362443 container create 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-30.el9, com.redhat.component=ubi9-container, io.spdk.git.branch=undefined, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.buildah.version=1.29.0, release=, io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, name=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.git.branch=devel, maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.nvmeof=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, architecture=x86_64, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.ceph-release=20.2.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, vcs-type=git) 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 podman[62425]: 2026-02-18 03:30:05.068309229 +0000 UTC m=+0.048789426 container init 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, release=, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, version=1.6.5, vcs-type=git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, architecture=x86_64, io.ceph.component=ceph-nvmeof, vendor=Red Hat, Inc., io.spdk.git.branch=undefined, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.nvmeof=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-30.el9, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.buildah.version=1.29.0, io.ceph.git.branch=devel) 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 podman[62425]: 2026-02-18 03:30:05.070540788 +0000 UTC m=+0.051020975 container start 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.wants=ceph,rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.repo=https://github.com/ceph/spdk.git, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, architecture=x86_64, url=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, version=1.6.5, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.6.5, io.ceph.maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.version=25.09, io.ceph.nvmeof=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.makeflags=, summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, vendor=Red Hat, Inc., vcs-type=git, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 bash[62425]: 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 podman[62425]: 2026-02-18 03:30:05.029482859 +0000 UTC m=+0.009963066 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 systemd[1]: Started Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:30:05.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [gateway] 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): port = 5500 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:30:05.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:30:05.462 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.b 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: nvmeof.nvmeof.b removed from nvmeof gateways dashboard config 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v201: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 168 KiB/s rd, 0 B/s wr, 32 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1875422616' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v202: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 234 KiB/s rd, 0 B/s wr, 89 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1250369666' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2334826475' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v203: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 139 KiB/s rd, 0 B/s wr, 125 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v204: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 158 KiB/s rd, 0 B/s wr, 127 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/109528844' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v205: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 0 B/s wr, 123 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v206: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 0 B/s wr, 123 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v207: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 130 KiB/s rd, 0 B/s wr, 109 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: pgmap v208: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 64 KiB/s rd, 0 B/s wr, 52 op/s 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: osdmap e51: 8 total, 8 up, 8 in 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 5m) 2026-02-18T03:30:05.472 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.473 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:05.473 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:30:05.474 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:30:05.474 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: Removing key for client.nvmeof.nvmeof.b 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: nvmeof.nvmeof.b removed from nvmeof gateways dashboard config 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v201: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 168 KiB/s rd, 0 B/s wr, 32 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1875422616' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v202: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 234 KiB/s rd, 0 B/s wr, 89 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1250369666' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2334826475' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v203: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 139 KiB/s rd, 0 B/s wr, 125 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v204: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 158 KiB/s rd, 0 B/s wr, 127 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/109528844' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v205: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 0 B/s wr, 123 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: mon.c calling monitor election 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: mon.a calling monitor election 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v206: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 120 KiB/s rd, 0 B/s wr, 123 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v207: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 130 KiB/s rd, 0 B/s wr, 109 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: pgmap v208: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 64 KiB/s rd, 0 B/s wr, 52 op/s 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: monmap epoch 3 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: min_mon_release 20 (tentacle) 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: election_strategy: 1 2026-02-18T03:30:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: fsmap 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: osdmap e51: 8 total, 8 up, 8 in 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: mgrmap e15: x(active, since 5m) 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:05.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:30:05.510 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): force_tls = False 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:30:05.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [discovery] 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): port = 8009 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [ceph] 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): pool = mypool 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [mtls] 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [spdk] 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): transports = tcp 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): [monitor] 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:30:05.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.86:5499 for group id 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:30:05.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:05] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 18, 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 354975, 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: 1 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.551 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.552 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:30:05.553 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:30:05.554 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "num": 30 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:30:05.555 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:30:05.556 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:30:05.557 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:30:05.557 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon c 2026-02-18T03:30:05.557 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 18, 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 317645, 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: 1 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.633 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.634 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.635 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:30:05.636 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "num": 50 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:30:05.637 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:30:05.638 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:30:05.638 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:30:05.639 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:30:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:05 trial155 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:30:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:05] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:30:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:05] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:30:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:05] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.155:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.155:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:30:05.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:05] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 103 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1090185122' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='client.40069 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.c"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: Remove daemons nvmeof.nvmeof.c 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: Removing daemon nvmeof.nvmeof.c from trial155 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: pgmap v209: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 58 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:06.413 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:06.414 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 108 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO state.py:1126 (108): Cleanup OMAP on exit (discovery-trial155) 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[50658]: [18-Feb-2026 03:30:06] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 podman[63518]: 2026-02-18 03:30:06.259040798 +0000 UTC m=+0.559620688 container died 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.build.ceph-release=20.2.0, version=1.6.5, io.ceph.maintainer=Ceph Developers , vcs-type=git, io.spdk.git.branch=undefined, io.buildah.version=1.29.0, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, io.spdk.build.makeflags=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9, release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd) 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 podman[63518]: 2026-02-18 03:30:06.272426117 +0000 UTC m=+0.573005997 container remove 32fa52bc81b150ba4f8bec0b9e3ebb03fc7dedbd7d0dd019e3246c51383552c9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, distribution-scope=public, io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.branch=devel, url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.pkgdep-args=--rbd, architecture=x86_64, org.centos.version=9.0-30.el9, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.component=ubi9-container, name=ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, vendor=Red Hat, Inc., summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, vcs-type=git, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.wants=ceph,rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 bash[63518]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:30:06.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:06 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 12min 26.229s CPU time, 1.5G memory peak. 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1090185122' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='client.40069 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.c"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: Remove daemons nvmeof.nvmeof.c 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: Removing daemon nvmeof.nvmeof.c from trial155 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:30:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: pgmap v209: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 58 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:07.030 INFO:teuthology.orchestra.run.trial155.stdout:Removed nvmeof.nvmeof.c from host 'trial155' 2026-02-18T03:30:07.042 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:30:07.042 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 74 secs before reviving 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: Removing key for client.nvmeof.nvmeof.c 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"}]': finished 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: nvmeof.nvmeof.c removed from nvmeof gateways dashboard config 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:07 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.c 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"}]': finished 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: nvmeof.nvmeof.c removed from nvmeof gateways dashboard config 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:07 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:07.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:30:07.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:30:07.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: INFO: Setting log level to WARNING 2026-02-18T03:30:07.588 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.323489] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.323591] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.439791] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.462352] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.462361] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.462370] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.462372] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:30:07.589 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.587970] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:30:07.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:30:07.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:30:07.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO discovery.py:369 (78): discovery addr: 10.20.193.86 port: 8009 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial086). 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial086). 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO state.py:2073 (78): Initialization is over (discovery-trial086). 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.635231] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.635258] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:30:07.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:30:07.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.941671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.86:0/2509951210, rc 0 2026-02-18T03:30:08.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.941744] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.86:0/2509951210 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.86:0/2509951210' 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.951749] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:07] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.956369] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.956639] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:07.956654] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.040708] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.86:0/17025835, rc 0 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.040759] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.86:0/17025835 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.86:0/17025835' 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.049878] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.054913] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.054933] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.139761] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.86:0/3322026774, rc 0 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.140633] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.86:0/3322026774 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.86:0/3322026774' 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.158613] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.163217] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.163240] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.252525] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.86:0/695550279, rc 0 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.252608] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.86:0/695550279 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.86:0/695550279' 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.262297] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.266838] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.266863] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.352392] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.86:0/1507958413, rc 0 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.352635] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.86:0/1507958413 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.86:0/1507958413' 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.362633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T03:30:08.409 INFO:tasks.workunit.client.0.trial014.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: git switch -c 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr:Or undo this operation with: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: git switch - 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr: 2026-02-18T03:30:08.410 INFO:tasks.workunit.client.0.trial014.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T03:30:08.417 DEBUG:teuthology.orchestra.run.trial014:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T03:30:08.475 INFO:tasks.workunit.client.0.trial014.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-18T03:30:08.476 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:30:08.476 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3369840086' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2286025675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: pgmap v210: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 0 B/s wr, 25 op/s 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:30:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:30:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:08 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:08.507 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3369840086' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2286025675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: pgmap v210: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 49 KiB/s rd, 0 B/s wr, 25 op/s 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:08.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:08.538 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-18T03:30:08.566 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-18T03:30:08.568 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:30:08.568 INFO:tasks.workunit.client.0.trial014.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-18T03:30:08.594 INFO:tasks.workunit.client.0.trial014.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-18T03:30:08.597 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-18T03:30:08.597 DEBUG:teuthology.orchestra.run.trial014:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.367126] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.367157] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.444387] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.86:0/3157232313, rc 0 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.444623] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.86:0/3157232313 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.86:0/3157232313' 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.453259] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.458094] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.458118] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.538524] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.86:0/1763803534, rc 0 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.538628] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.86:0/1763803534 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.86:0/1763803534' 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.547460] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.552286] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.552310] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.654 INFO:tasks.workunit:Running workunits matching nvmeof/fio_test.sh on client.0... 2026-02-18T03:30:08.655 INFO:tasks.workunit:Running workunit nvmeof/fio_test.sh... 2026-02-18T03:30:08.655 DEBUG:teuthology.orchestra.run.trial014:workunit test nvmeof/fio_test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 IOSTAT_INTERVAL=10 NVMEOF_GROUP=mygroup0 RBD_POOL=mypool RUNTIME=1200 timeout 60m /home/ubuntu/cephtest/clone.client.0/qa/workunits/nvmeof/fio_test.sh --random_devices 32 2026-02-18T03:30:08.710 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo yum -y install fio 2026-02-18T03:30:08.912 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.636923] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.86:0/2597020416, rc 0 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.637629] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.86:0/2597020416 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.86:0/2597020416' 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.647650] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.652176] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.652197] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.913 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.736168] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.86:0/3504874584, rc 0 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.736220] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.86:0/3504874584 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.86:0/3504874584' 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.745901] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.750460] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.750482] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:08.914 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.838449] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.86:0/62739898, rc 0 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.838512] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.86:0/62739898 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.86:0/62739898' 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.847811] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.852367] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.852389] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:08.915 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.004 INFO:tasks.workunit.client.0.trial014.stdout:Last metadata expiration check: 0:07:18 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:30:09.159 INFO:tasks.workunit.client.0.trial014.stdout:Dependencies resolved. 2026-02-18T03:30:09.159 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:30:09.159 INFO:tasks.workunit.client.0.trial014.stdout: Package Architecture Version Repository Size 2026-02-18T03:30:09.159 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:30:09.159 INFO:tasks.workunit.client.0.trial014.stdout:Installing: 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout:Installing weak dependencies: 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:30:09.160 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout:Transaction Summary 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout:================================================================================ 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout:Install 7 Packages 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:09.161 INFO:tasks.workunit.client.0.trial014.stdout:Total download size: 6.3 M 2026-02-18T03:30:09.162 INFO:tasks.workunit.client.0.trial014.stdout:Installed size: 8.7 M 2026-02-18T03:30:09.162 INFO:tasks.workunit.client.0.trial014.stdout:Downloading Packages: 2026-02-18T03:30:09.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.936147] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.86:0/40649533, rc 0 2026-02-18T03:30:09.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.936207] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.86:0/40649533 2026-02-18T03:30:09.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.86:0/40649533' 2026-02-18T03:30:09.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.945773] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:08] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.950650] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:08.950672] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.038333] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.86:0/1638428841, rc 0 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.038614] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.86:0/1638428841 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.86:0/1638428841' 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.048061] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.052952] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:30:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.052973] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.136984] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.86:0/3430494148, rc 0 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.137033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.86:0/3430494148 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.86:0/3430494148' 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.146589] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.151115] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.151134] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.332 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.332 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.332 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:30:09.333 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:09.334 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:30:09.334 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.334 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.334 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.334 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 systemd[1]: Starting Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 podman[64142]: 2026-02-18 03:30:09.126661987 +0000 UTC m=+0.017569263 container create 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.wants=ceph,rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.ceph.component=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.6.5, io.spdk.build.pkgdep-args=--rbd, io.spdk.version=25.09, io.spdk.git.branch=undefined, io.ceph.nvmeof=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.branch=devel, io.ceph.maintainer=Ceph Developers , version=1.6.5, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., architecture=x86_64, io.spdk.build.ceph-release=20.2.0, io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, distribution-scope=public) 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 podman[64142]: 2026-02-18 03:30:09.153094542 +0000 UTC m=+0.044001828 container init 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., architecture=x86_64, name=ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.ceph.version=1.6.5, io.ceph.maintainer=Ceph Developers , distribution-scope=public, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, version=1.6.5, io.spdk.git.branch=undefined, io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, maintainer=Ceph Developers , url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, io.spdk.build.makeflags=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-30.el9, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 podman[64142]: 2026-02-18 03:30:09.155559417 +0000 UTC m=+0.046466693 container start 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.openshift.wants=ceph,rbd, url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.branch=devel, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., io.ceph.nvmeof=, io.ceph.component=ceph-nvmeof, org.centos.version=9.0-30.el9, io.ceph.version=1.6.5, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.spdk.build.makeflags=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.component=ubi9-container, architecture=x86_64, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 bash[64142]: 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 podman[64142]: 2026-02-18 03:30:09.119198164 +0000 UTC m=+0.010105440 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 systemd[1]: Started Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:30:09.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:30:09.439 INFO:tasks.workunit.client.0.trial014.stdout:(1/7): fio-engine-libaio-3.35-1.el9.x86_64.rpm 79 kB/s | 16 kB 00:00 2026-02-18T03:30:09.444 INFO:tasks.workunit.client.0.trial014.stdout:(2/7): fio-engine-http-3.35-1.el9.x86_64.rpm 89 kB/s | 18 kB 00:00 2026-02-18T03:30:09.511 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.236325] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.86:0/3634568809, rc 0 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.244641] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.86:0/3634568809 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.86:0/3634568809' 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.253925] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.258460] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.258480] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.338647] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.86:0/2568948098, rc 0 2026-02-18T03:30:09.512 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.344626] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.86:0/2568948098 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.86:0/2568948098' 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.354317] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.358852] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.358871] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.439053] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.86:0/3105526502, rc 0 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.439109] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.86:0/3105526502 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.86:0/3105526502' 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.449016] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.513 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:30:09.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.454141] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:30:09.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.454163] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.514 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:30:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:09.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:30:09.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:09.625 INFO:tasks.workunit.client.0.trial014.stdout:(3/7): fio-engine-nbd-3.35-1.el9.x86_64.rpm 78 kB/s | 15 kB 00:00 2026-02-18T03:30:09.630 INFO:tasks.workunit.client.0.trial014.stdout:(4/7): fio-engine-rados-3.35-1.el9.x86_64.rpm 85 kB/s | 16 kB 00:00 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:30:09.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [gateway] 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:30:09.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): port = 5500 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:30:09.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:30:09.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:30:09.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): force_tls = False 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:30:09.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:30:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:30:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:30:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:30:09.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [discovery] 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): port = 8009 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:30:09.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [ceph] 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): pool = mypool 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [mtls] 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:30:09.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [spdk] 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): transports = tcp 2026-02-18T03:30:09.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): [monitor] 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:30:09.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:30:09.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:30:09.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:30:09.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:09 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:09] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.155:5499 for group id 2026-02-18T03:30:09.803 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.534136] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.86:0/2880555296, rc 0 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.534193] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.86:0/2880555296 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.86:0/2880555296' 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.543697] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.548572] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.548597] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.804 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.628445] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.86:0/1012487708, rc 0 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.628503] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.86:0/1012487708 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.86:0/1012487708' 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.638830] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.643433] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.643454] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.731357] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.86:0/2733649533, rc 0 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.731415] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.86:0/2733649533 2026-02-18T03:30:09.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.86:0/2733649533' 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.741075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.745575] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.745601] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:09.816 INFO:tasks.workunit.client.0.trial014.stdout:(5/7): fio-engine-rbd-3.35-1.el9.x86_64.rpm 85 kB/s | 16 kB 00:00 2026-02-18T03:30:09.834 INFO:tasks.workunit.client.0.trial014.stdout:(6/7): fio-engine-rdma-3.35-1.el9.x86_64.rpm 101 kB/s | 21 kB 00:00 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.825697] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.86:0/2177389074, rc 0 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.825753] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.86:0/2177389074 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.86:0/2177389074' 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.835319] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.839860] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.839879] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:10.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.923840] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.86:0/4074389583, rc 0 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.923898] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.86:0/4074389583 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.86:0/4074389583' 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.933320] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.938288] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:09.938307] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.018166] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.86:0/269839584, rc 0 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.018222] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.86:0/269839584 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.86:0/269839584' 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.027863] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.032659] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.032680] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.112861] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.86:0/1543690002, rc 0 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.112918] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.86:0/1543690002 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.86:0/1543690002' 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.122653] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.127096] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.127116] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.213496] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.86:0/2831632092, rc 0 2026-02-18T03:30:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.213569] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.86:0/2831632092 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.86:0/2831632092' 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.223060] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.227598] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.227618] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.307564] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.86:0/200048370, rc 0 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.307629] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.86:0/200048370 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.86:0/200048370' 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.317615] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:30:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.328808] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:30:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.328828] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: pgmap v211: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 86 KiB/s rd, 255 B/s wr, 73 op/s 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:10.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:10.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: pgmap v211: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 86 KiB/s rd, 255 B/s wr, 73 op/s 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:30:10.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:30:10.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:10] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:30:10.634 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:10.635 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:30:10.662 INFO:tasks.workunit.client.0.trial014.stdout:(7/7): fio-3.35-1.el9.x86_64.rpm 4.4 MB/s | 6.2 MB 00:01 2026-02-18T03:30:10.662 INFO:tasks.workunit.client.0.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-18T03:30:10.662 INFO:tasks.workunit.client.0.trial014.stdout:Total 4.2 MB/s | 6.3 MB 00:01 2026-02-18T03:30:10.677 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.410486] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.86:0/2966005620, rc 0 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.410626] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.86:0/2966005620 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.86:0/2966005620' 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.420124] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.424676] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.424697] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.508669] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.86:0/695583686, rc 0 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.508726] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.86:0/695583686 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.86:0/695583686' 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.518235] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.523020] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.523041] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.606927] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.86:0/3427166531, rc 0 2026-02-18T03:30:10.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.606985] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.86:0/3427166531 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.86:0/3427166531' 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.616426] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.620931] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.620953] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.680 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.728 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction check 2026-02-18T03:30:10.734 INFO:tasks.workunit.client.0.trial014.stdout:Transaction check succeeded. 2026-02-18T03:30:10.734 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction test 2026-02-18T03:30:10.792 INFO:tasks.workunit.client.0.trial014.stdout:Transaction test succeeded. 2026-02-18T03:30:10.792 INFO:tasks.workunit.client.0.trial014.stdout:Running transaction 2026-02-18T03:30:10.871 INFO:tasks.workunit.client.0.trial014.stdout: Preparing : 1/1 2026-02-18T03:30:10.873 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/7 2026-02-18T03:30:10.874 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/7 2026-02-18T03:30:10.875 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/7 2026-02-18T03:30:10.877 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/7 2026-02-18T03:30:10.878 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/7 2026-02-18T03:30:10.934 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/7 2026-02-18T03:30:10.952 INFO:tasks.workunit.client.0.trial014.stdout: Installing : fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:30:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.700977] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.86:0/4007329858, rc 0 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.701033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.86:0/4007329858 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.86:0/4007329858' 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.711626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.723853] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.723872] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.804076] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.86:0/1186688424, rc 0 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.804649] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.86:0/1186688424 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.86:0/1186688424' 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.814009] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.818564] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.818585] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.898564] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.86:0/2614816068, rc 0 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.898623] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.86:0/2614816068 2026-02-18T03:30:10.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.86:0/2614816068' 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.908432] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.913323] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.913344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:10.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Running scriptlet: fio-3.35-1.el9.x86_64 7/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-3.35-1.el9.x86_64 1/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/7 2026-02-18T03:30:11.206 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/7 2026-02-18T03:30:11.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.993112] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.86:0/877628844, rc 0 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:10.993169] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.86:0/877628844 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.86:0/877628844' 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.002525] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.007294] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.007314] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.084109] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.088478] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.088499] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.169072] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.173660] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.173680] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.263 INFO:tasks.workunit.client.0.trial014.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/7 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout:Installed: 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: fio-3.35-1.el9.x86_64 fio-engine-http-3.35-1.el9.x86_64 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-libaio-3.35-1.el9.x86_64 fio-engine-nbd-3.35-1.el9.x86_64 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-rados-3.35-1.el9.x86_64 fio-engine-rbd-3.35-1.el9.x86_64 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.264 INFO:tasks.workunit.client.0.trial014.stdout:Complete! 2026-02-18T03:30:11.291 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo yum -y install sysstat 2026-02-18T03:30:11.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.249146] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.253583] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.253609] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.325399] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.329790] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:30:11.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.329811] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.406511] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.410949] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.410970] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.491419] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:30:11.585 INFO:tasks.workunit.client.0.trial014.stdout:Last metadata expiration check: 0:07:20 ago on Wed 18 Feb 2026 03:22:51 AM UTC. 2026-02-18T03:30:11.648 INFO:tasks.workunit.client.0.trial014.stdout:Package sysstat-12.5.4-9.el9.x86_64 is already installed. 2026-02-18T03:30:11.666 INFO:tasks.workunit.client.0.trial014.stdout:Dependencies resolved. 2026-02-18T03:30:11.667 INFO:tasks.workunit.client.0.trial014.stdout:Nothing to do. 2026-02-18T03:30:11.667 INFO:tasks.workunit.client.0.trial014.stdout:Complete! 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ namespace_range_start= 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ namespace_range_end= 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ random_devices_count= 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ rbd_iostat=false 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ [[ 2 -gt 0 ]] 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ case "$1" in 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ random_devices_count=32 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ shift 2 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:+ [[ 0 -gt 0 ]] 2026-02-18T03:30:11.688 INFO:tasks.workunit.client.0.trial014.stderr:++ mktemp -t nvmeof-fio-XXXX 2026-02-18T03:30:11.689 INFO:tasks.workunit.client.0.trial014.stderr:+ fio_file=/tmp/nvmeof-fio-U8NC 2026-02-18T03:30:11.689 INFO:tasks.workunit.client.0.trial014.stderr:++ sudo nvme list --output-format=json 2026-02-18T03:30:11.689 INFO:tasks.workunit.client.0.trial014.stderr:++ jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2026-02-18T03:30:11.729 INFO:tasks.workunit.client.0.trial014.stderr:+ all_drives_list='/dev/nvme8n3 2026-02-18T03:30:11.729 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme12n3 2026-02-18T03:30:11.729 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme16n3 2026-02-18T03:30:11.729 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme20n3 2026-02-18T03:30:11.729 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme24n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme28n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme32n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme36n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme4n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme40n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme44n3 2026-02-18T03:30:11.730 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme48n3 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme52n3 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme56n3 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme60n3 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme64n3' 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' '' ']' 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' '' ']' 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 32 ']' 2026-02-18T03:30:11.731 INFO:tasks.workunit.client.0.trial014.stderr:++ echo '/dev/nvme8n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme12n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme16n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme20n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme24n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme28n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme32n3 2026-02-18T03:30:11.732 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme36n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme4n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme40n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme44n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme48n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme52n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme56n3 2026-02-18T03:30:11.733 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme60n3 2026-02-18T03:30:11.734 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme64n3' 2026-02-18T03:30:11.734 INFO:tasks.workunit.client.0.trial014.stderr:++ shuf -n 32 2026-02-18T03:30:11.739 INFO:tasks.workunit.client.0.trial014.stderr:+ selected_drives='/dev/nvme36n3 2026-02-18T03:30:11.739 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme40n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme28n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme32n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme64n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme48n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme44n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme60n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme16n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme24n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme8n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme4n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme56n3 2026-02-18T03:30:11.740 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme20n3 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme52n3 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:/dev/nvme12n3' 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ RUNTIME=1200 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ cat 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme36n3]' 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme36n3 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme40n3]' 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme40n3 2026-02-18T03:30:11.741 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme28n3]' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme28n3 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme32n3]' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme32n3 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme64n3]' 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme64n3 2026-02-18T03:30:11.742 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme48n3]' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme48n3 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme44n3]' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme44n3 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme60n3]' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme60n3 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.743 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme16n3]' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme16n3 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme24n3]' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme24n3 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme8n3]' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme8n3 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.744 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme4n3]' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme4n3 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme56n3]' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme56n3 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme20n3]' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme20n3 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme52n3]' 2026-02-18T03:30:11.745 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme52n3 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ for i in $selected_drives 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[job-/dev/nvme12n3]' 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ echo filename=/dev/nvme12n3 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '' 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stderr:+ cat /tmp/nvmeof-fio-U8NC 2026-02-18T03:30:11.746 INFO:tasks.workunit.client.0.trial014.stdout:[global] 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:ioengine=sync 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:bsrange=4k-64k 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:numjobs=1 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:size=1G 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:time_based=1 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:runtime=1200 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:rw=randrw 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:verify=md5 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:verify_fatal=1 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:do_verify=1 2026-02-18T03:30:11.747 INFO:tasks.workunit.client.0.trial014.stdout:serialize_overlap=1 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:group_reporting 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:direct=1 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme36n3] 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme36n3 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme40n3] 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme40n3 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme28n3] 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme28n3 2026-02-18T03:30:11.748 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme32n3] 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme32n3 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme64n3] 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme64n3 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme48n3] 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme48n3 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme44n3] 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme44n3 2026-02-18T03:30:11.749 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme60n3] 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme60n3 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme16n3] 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme16n3 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme24n3] 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme24n3 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme8n3] 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme8n3 2026-02-18T03:30:11.750 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme4n3] 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme4n3 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme56n3] 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme56n3 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme20n3] 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme20n3 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme52n3] 2026-02-18T03:30:11.751 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme52n3 2026-02-18T03:30:11.752 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.752 INFO:tasks.workunit.client.0.trial014.stdout:[job-/dev/nvme12n3] 2026-02-18T03:30:11.752 INFO:tasks.workunit.client.0.trial014.stdout:filename=/dev/nvme12n3 2026-02-18T03:30:11.752 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.752 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof.fio] starting fio test... 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof.fio] starting fio test...' 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' -n 10 ']' 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ iostat_count=120 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' false = true ']' 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ fio --showcmd /tmp/nvmeof-fio-U8NC 2026-02-18T03:30:11.753 INFO:tasks.workunit.client.0.trial014.stderr:+ iostat -d -p /dev/nvme36n3 /dev/nvme40n3 /dev/nvme28n3 /dev/nvme32n3 /dev/nvme64n3 /dev/nvme48n3 /dev/nvme44n3 /dev/nvme60n3 /dev/nvme16n3 /dev/nvme24n3 /dev/nvme8n3 /dev/nvme4n3 /dev/nvme56n3 /dev/nvme20n3 /dev/nvme52n3 /dev/nvme12n3 10 120 -h 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.495819] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.495840] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.572694] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.577057] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.577077] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.662124] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.666708] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.666730] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.751019] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:11.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout:Linux 5.14.0-681.el9.x86_64 (trial014) 02/18/2026 _x86_64_ (24 CPU) 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme12n3 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme16n3 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme20n3 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme24n3 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme28n3 2026-02-18T03:30:11.760 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme32n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme36n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme40n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme44n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme48n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme4n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme52n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme56n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme60n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme64n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 0.09 1.8k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n3 2026-02-18T03:30:11.761 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:11.873 INFO:tasks.workunit.client.0.trial014.stdout:fio --ioengine=sync --bsrange=4k-64k --numjobs=1 --size=1G --time_based=1 --runtime=1200 --rw=randrw --verify=md5 --verify_fatal=1 --do_verify=1 --serialize_overlap=1 --group_reporting --direct=1 --name=job-/dev/nvme36n3 --filename=/dev/nvme36n3 --name=job-/dev/nvme40n3 --filename=/dev/nvme40n3 --name=job-/dev/nvme28n3 --filename=/dev/nvme28n3 --name=job-/dev/nvme32n3 --filename=/dev/nvme32n3 --name=job-/dev/nvme64n3 --filename=/dev/nvme64n3 --name=job-/dev/nvme48n3 --filename=/dev/nvme48n3 --name=job-/dev/nvme44n3 --filename=/dev/nvme44n3 --name=job-/dev/nvme60n3 --filename=/dev/nvme60n3 --name=job-/dev/nvme16n3 --filename=/dev/nvme16n3 --name=job-/dev/nvme24n3 --filename=/dev/nvme24n3 --name=job-/dev/nvme8n3 --filename=/dev/nvme8n3 --name=job-/dev/nvme4n3 --filename=/dev/nvme4n3 --name=job-/dev/nvme56n3 --filename=/dev/nvme56n3 --name=job-/dev/nvme20n3 --filename=/dev/nvme20n3 --name=job-/dev/nvme52n3 --filename=/dev/nvme52n3 --name=job-/dev/nvme12n3 --filename=/dev/nvme12n3 2026-02-18T03:30:11.873 INFO:tasks.workunit.client.0.trial014.stderr:+ set +e 2026-02-18T03:30:11.874 INFO:tasks.workunit.client.0.trial014.stderr:+ sudo fio /tmp/nvmeof-fio-U8NC 2026-02-18T03:30:12.021 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme36n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme40n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme28n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme32n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme64n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme48n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme44n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme60n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme16n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme24n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme8n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.022 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme4n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme56n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme20n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme52n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme12n3: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:fio-3.35 2026-02-18T03:30:12.023 INFO:tasks.workunit.client.0.trial014.stdout:Starting 16 processes 2026-02-18T03:30:12.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.755420] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:30:12.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.755441] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:12.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.054 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.832066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.836437] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.836458] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.913499] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.917908] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.917930] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.993690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:11] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.998022] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:11 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:11.998041] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:11 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3225408813' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:12.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3225408813' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:12.309 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.079475] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.083925] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.083944] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.164446] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.168792] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:30:12.310 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.168814] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.249355] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.253913] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.253931] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.311 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.333966] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:30:12.576 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.338324] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.338344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.415619] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.419993] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.420015] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.500639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.577 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:30:12.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.510812] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:30:12.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.510837] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:12.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.578 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:30:12.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:30:12.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: INFO: Setting log level to WARNING 2026-02-18T03:30:12.681 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.412377] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.412425] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.528208] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.555723] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.555732] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.555740] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.555741] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:30:12.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.680455] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:30:12.840 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.597633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.601964] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.601983] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.678818] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.683323] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:30:12.841 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.683343] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.759015] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.763363] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.763385] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.839616] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.842 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:30:12.937 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-mon[24719]: pgmap v212: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 233 KiB/s rd, 938 B/s wr, 233 op/s 2026-02-18T03:30:12.938 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-mon[24719]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:30:12.938 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2372891847' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:30:12.938 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3132272331' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:12.939 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:30:12.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO discovery.py:369 (81): discovery addr: 10.20.193.155 port: 8009 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial155). 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:30:12.941 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial155). 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO state.py:2073 (81): Initialization is over (discovery-trial155). 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.727730] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:12.727764] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:30:12.942 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:30:12.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:12.946 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:30:12.947 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.843996] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:30:13.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.844016] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:13.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.113 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.924709] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.929118] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:12.929138] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.009626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.031855] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.031886] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.114 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.112167] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.115 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:12 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.031433] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.155:0/4142924395, rc 0 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.031510] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.155:0/4142924395 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.155:0/4142924395' 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.041767] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:30:13.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.046428] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.046652] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.046667] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.122188] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.155:0/3857573178, rc 0 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.122242] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.155:0/3857573178 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.155:0/3857573178' 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.132146] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.137221] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:30:13.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.137242] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:13.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:12 trial034 ceph-mon[21825]: pgmap v212: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 233 KiB/s rd, 938 B/s wr, 233 op/s 2026-02-18T03:30:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:12 trial034 ceph-mon[21825]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:30:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:12 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2372891847' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:30:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:12 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3132272331' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:13.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.116604] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:30:13.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.116625] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.204986] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.209417] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.209437] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.298098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.302479] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.302498] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.212982] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.155:0/1819766024, rc 0 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.213045] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.155:0/1819766024 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.155:0/1819766024' 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.223550] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.228026] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:30:13.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.228048] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.307592] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.155:0/837153192, rc 0 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.317031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.155:0/837153192 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.155:0/837153192' 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.328029] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.353240] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.353272] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.428768] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.155:0/3355854953, rc 0 2026-02-18T03:30:13.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.428821] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.155:0/3355854953 2026-02-18T03:30:13.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.155:0/3355854953' 2026-02-18T03:30:13.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.439027] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.386888] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:30:13.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.391288] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.391310] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.476626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.485928] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.485958] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.565737] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:30:13.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.570307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:30:13.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.570330] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.459259] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.459290] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.530601] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.155:0/3563929692, rc 0 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.530652] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.155:0/3563929692 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.155:0/3563929692' 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.540091] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:30:13.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.544725] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.544745] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.616163] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.155:0/2324201373, rc 0 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.616219] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.155:0/2324201373 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.155:0/2324201373' 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.626717] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.631784] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.631804] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.707647] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.155:0/125894617, rc 0 2026-02-18T03:30:13.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.707793] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.155:0/125894617 2026-02-18T03:30:13.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.155:0/125894617' 2026-02-18T03:30:13.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.647947] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.652350] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.652369] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.737680] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.742430] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.742450] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:13.802228] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.86 port 4420 *** 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:13.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:13.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:13.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:13.886 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.717185] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.721601] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.721622] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.797657] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.155:0/3613028259, rc 0 2026-02-18T03:30:13.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.797720] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.155:0/3613028259 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.155:0/3613028259' 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.808207] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.812747] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.812768] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.892235] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.155:0/3662765863, rc 0 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.892291] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.155:0/3662765863 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.155:0/3662765863' 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.903294] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:13.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:30:13.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.907941] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:30:13.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.907961] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:13.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:13.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.995516] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.155:0/422944550, rc 0 2026-02-18T03:30:14.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:13.995582] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.155:0/422944550 2026-02-18T03:30:14.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.155:0/422944550' 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.006267] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.010882] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.010905] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.094540] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.155:0/2391352469, rc 0 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.094603] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.155:0/2391352469 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.155:0/2391352469' 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.104799] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.109799] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.109822] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:14.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.189605] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.155:0/3268802503, rc 0 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.190028] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.155:0/3268802503 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.155:0/3268802503' 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.200255] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:30:14.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.204832] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:30:14.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.204855] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:30:14.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:14.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:30:14.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:30:14.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:14] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:30:14.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:14.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:14 trial034 ceph-mon[21825]: pgmap v213: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 430 KiB/s rd, 2.3 KiB/s wr, 488 op/s 2026-02-18T03:30:14.532 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:30:14.532 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-mon[24719]: pgmap v213: 33 pgs: 33 active+clean; 612 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail; 430 KiB/s rd, 2.3 KiB/s wr, 488 op/s 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.280474] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.155:0/1432860265, rc 0 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.281030] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.155:0/1432860265 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.155:0/1432860265' 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.290744] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.295301] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:30:14.533 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.295322] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.396386] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.155:0/482030057, rc 0 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.397039] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.155:0/482030057 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.155:0/482030057' 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.413111] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.417811] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.417839] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.534 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.535 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.531726] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.155:0/2353148884, rc 0 2026-02-18T03:30:14.795 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.531868] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.155:0/2353148884 2026-02-18T03:30:14.795 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.155:0/2353148884' 2026-02-18T03:30:14.795 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.544031] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.795 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.549158] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.549190] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.666320] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.155:0/3779360768, rc 0 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.667038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.155:0/3779360768 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.155:0/3779360768' 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.679023] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.680608] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:30:14.796 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.680638] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:14.797 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:14.797 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:14.797 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.794098] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.155:0/2060509388, rc 0 2026-02-18T03:30:15.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.795044] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.155:0/2060509388 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.155:0/2060509388' 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.808038] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.812864] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.812907] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:15.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.926711] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.155:0/2045355357, rc 0 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.926830] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.155:0/2045355357 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.155:0/2045355357' 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.944866] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:14] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.950367] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:14.950415] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.063891] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.155:0/1406799672, rc 0 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.063981] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.155:0/1406799672 2026-02-18T03:30:15.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.155:0/1406799672' 2026-02-18T03:30:15.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1412389055' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:15.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.075602] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.076895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.076927] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.186616] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.155:0/4265181314, rc 0 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.187031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.155:0/4265181314 2026-02-18T03:30:15.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.155:0/4265181314' 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.199010] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.224312] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.224357] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.337423] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.155:0/1388700749, rc 0 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.337514] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.155:0/1388700749 2026-02-18T03:30:15.340 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.155:0/1388700749' 2026-02-18T03:30:15.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.347054] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:30:15.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.352443] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:30:15.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.352476] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:15.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.457419] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.155:0/3471044943, rc 0 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.458032] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.155:0/3471044943 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.155:0/3471044943' 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.477559] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.487213] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.487253] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:15.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.605888] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.155:0/1921565020, rc 0 2026-02-18T03:30:15.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.606049] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.155:0/1921565020 2026-02-18T03:30:15.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1412389055' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:15.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.155:0/1921565020' 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.623061] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.627788] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.627822] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.725562] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.155:0/4170339253, rc 0 2026-02-18T03:30:15.866 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.729040] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.155:0/4170339253 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.155:0/4170339253' 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.741023] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.746765] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.746797] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.851246] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.155:0/106753563, rc 0 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.852052] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.155:0/106753563 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.155:0/106753563' 2026-02-18T03:30:15.867 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.864719] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:30:15] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:30:15.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:30:15.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: OPTIMIZED 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:30:15.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: ], , client address: IPv4 10.20.193.177:60386 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.616527] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000238 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.632479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000217 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.648479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000185 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.664471] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000207 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.680450] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000194 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.696451] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000182 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.712483] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000227 seconds 2026-02-18T03:30:15.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.728479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000219 seconds 2026-02-18T03:30:16.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:30:16.121 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.880391] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.880432] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.985897] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.155:0/2304562095, rc 0 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.986047] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.155:0/2304562095 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.155:0/2304562095' 2026-02-18T03:30:16.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:15.997521] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:15] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.002394] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.002423] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.107425] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.155:0/1888435832, rc 0 2026-02-18T03:30:16.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.107522] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.155:0/1888435832 2026-02-18T03:30:16.124 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.155:0/1888435832' 2026-02-18T03:30:16.124 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.119851] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.381 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.126151] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.126188] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.240195] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.155:0/2853757488, rc 0 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.241057] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.155:0/2853757488 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.155:0/2853757488' 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.257680] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.382 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.262751] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.262784] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.380609] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.155:0/1283892613, rc 0 2026-02-18T03:30:16.383 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.380738] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.155:0/1283892613 2026-02-18T03:30:16.645 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-mon[24719]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:30:16.646 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-mon[24719]: pgmap v215: 33 pgs: 33 active+clean; 4.0 GiB data, 462 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 2.74k op/s 2026-02-18T03:30:16.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.155:0/1283892613' 2026-02-18T03:30:16.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.391605] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.396865] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.396908] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.506506] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.155:0/3947113045, rc 0 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.506671] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.155:0/3947113045 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.155:0/3947113045' 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.518572] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:30:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.534324] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:30:16.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.534368] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:16.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.645070] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.155:0/1277316140, rc 0 2026-02-18T03:30:16.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:16] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:30:16.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:30:16.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 2 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:37332 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.618546] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000235 seconds 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.634557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000233 seconds 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.650636] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000353 seconds 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.666884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000585 seconds 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.682522] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000248 seconds 2026-02-18T03:30:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.698635] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000332 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.714508] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000243 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.734609] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000329 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.750694] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000402 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.766527] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000255 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.790869] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000601 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.806693] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000401 seconds 2026-02-18T03:30:16.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:16.830573] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000269 seconds 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.650044] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.155:0/1277316140 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.155:0/1277316140' 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.664137] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.668709] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.668750] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:16.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.770623] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.775307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.775364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.882056] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.919998] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:30:16.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:16.920062] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:16 trial034 ceph-mon[21825]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:30:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:16 trial034 ceph-mon[21825]: pgmap v215: 33 pgs: 33 active+clean; 4.0 GiB data, 462 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 2.74k op/s 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.027221] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.031856] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.031893] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.142932] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.147546] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.147583] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.260044] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:30:17.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.289274] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:30:17.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.289323] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:17.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.448253] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:30:17.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.452905] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:30:17.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.452947] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.559149] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.563840] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.563882] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:17.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.671728] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.676378] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.676414] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:17.787 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.785047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:30:18.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.808402] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:30:18.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.808459] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:18.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.915282] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.920250] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:17.920288] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.024049] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:30:18.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.058001] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:30:18.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.058070] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:18.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.190500] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.338 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:30:18.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.214719] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:30:18.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.214771] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:18.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.339 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.337194] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:30:18.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.341839] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:30:18.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.341878] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:18.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.453046] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.475396] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.475445] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.592 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.590022] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.846 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-mon[24719]: pgmap v216: 33 pgs: 33 active+clean; 8.4 GiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 19 MiB/s rd, 37 MiB/s wr, 5.78k op/s 2026-02-18T03:30:18.846 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3527073288' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:18.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:30:18.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.594801] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:30:18.846 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.594846] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.712058] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.734417] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.734482] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:18.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.845305] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:18 trial034 ceph-mon[21825]: pgmap v216: 33 pgs: 33 active+clean; 8.4 GiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 19 MiB/s rd, 37 MiB/s wr, 5.78k op/s 2026-02-18T03:30:19.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3527073288' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.849908] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.849944] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.959086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:18] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:30:19.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.963598] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:18.963633] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.071664] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.076303] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.076344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.180043] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.191682] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.191725] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.298820] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:30:19.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.303384] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:30:19.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.303426] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:19.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.407037] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:19.305241] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:30:19.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:30:19.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.419307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:30:19.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.419344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:19.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.519447] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.524711] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.524752] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.631257] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.635914] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.635950] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:19.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.746985] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.751552] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.751591] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.863042] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:19] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.899008] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:30:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:19.899075] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:20.277 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.277 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.277 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.035965] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.277 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.040843] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.040890] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.155877] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.160459] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.160497] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.276368] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.281408] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.281488] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.402047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.424259] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.424314] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.546664] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.803 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-mon[24719]: pgmap v217: 33 pgs: 33 active+clean; 12 GiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 31 MiB/s rd, 58 MiB/s wr, 7.56k op/s 2026-02-18T03:30:20.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.551641] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.551684] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.680050] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.705315] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.705365] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:20.804 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:20.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:20] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:30:20.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:30:20.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:30:20.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:20.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:37388 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.614311] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000309 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.637169] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.003230 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.669994] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000223 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.686063] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000272 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.702024] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000252 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.718084] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000310 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.734137] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000370 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.750012] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000240 seconds 2026-02-18T03:30:20.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.774116] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000289 seconds 2026-02-18T03:30:20.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.790077] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000270 seconds 2026-02-18T03:30:20.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.822091] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000276 seconds 2026-02-18T03:30:20.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.838139] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000339 seconds 2026-02-18T03:30:20.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:30:20.854071] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000290 seconds 2026-02-18T03:30:21.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:20 trial034 ceph-mon[21825]: pgmap v217: 33 pgs: 33 active+clean; 12 GiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 31 MiB/s rd, 58 MiB/s wr, 7.56k op/s 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:20.804791] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.155 port 4420 *** 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.058 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:20] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.068 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:30:21.069 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:21] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:30:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 630.90 9.7M 9.5M 0.0k 96.7M 94.8M 0.0k nvme12n3 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 635.90 9.9M 10.0M 0.0k 99.4M 100.2M 0.0k nvme16n3 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 632.90 10.0M 9.9M 0.0k 100.0M 99.2M 0.0k nvme20n3 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 624.50 10.0M 9.6M 0.0k 100.1M 95.5M 0.0k nvme24n3 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 640.30 9.9M 10.1M 0.0k 98.6M 100.5M 0.0k nvme28n3 2026-02-18T03:30:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 650.00 10.1M 10.0M 0.0k 100.7M 100.5M 0.0k nvme32n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 637.10 9.7M 9.8M 0.0k 96.7M 98.4M 0.0k nvme36n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 622.60 9.7M 10.1M 0.0k 97.4M 101.4M 0.0k nvme40n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 640.90 10.1M 9.8M 0.0k 100.8M 98.2M 0.0k nvme44n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 652.30 10.4M 9.8M 0.0k 104.0M 98.4M 0.0k nvme48n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 631.50 9.9M 9.8M 0.0k 99.4M 97.8M 0.0k nvme4n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 633.00 10.0M 9.8M 0.0k 100.1M 98.1M 0.0k nvme52n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 640.80 10.1M 9.8M 0.0k 101.5M 98.1M 0.0k nvme56n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 636.70 9.9M 10.1M 0.0k 99.2M 100.5M 0.0k nvme60n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 619.60 9.8M 9.5M 0.0k 98.1M 95.2M 0.0k nvme64n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 662.10 10.5M 10.1M 0.0k 104.7M 101.0M 0.0k nvme8n3 2026-02-18T03:30:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:21.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4117420091' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:22.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4117420091' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:22.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/624633789' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:22.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:22 trial155 ceph-mon[24719]: pgmap v218: 33 pgs: 33 active+clean; 14 GiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 66 MiB/s rd, 105 MiB/s wr, 10.92k op/s 2026-02-18T03:30:23.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/624633789' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:23.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:22 trial034 ceph-mon[21825]: pgmap v218: 33 pgs: 33 active+clean; 14 GiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 66 MiB/s rd, 105 MiB/s wr, 10.92k op/s 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:30:23] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:30:24.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:30:24.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:37414 2026-02-18T03:30:24.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:24 trial155 ceph-mon[24719]: pgmap v219: 33 pgs: 33 active+clean; 15 GiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 103 MiB/s rd, 151 MiB/s wr, 13.77k op/s 2026-02-18T03:30:25.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:24 trial034 ceph-mon[21825]: pgmap v219: 33 pgs: 33 active+clean; 15 GiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 103 MiB/s rd, 151 MiB/s wr, 13.77k op/s 2026-02-18T03:30:25.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:25 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1828520528' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:26.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1828520528' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-mon[24719]: pgmap v220: 33 pgs: 33 active+clean; 15 GiB data, 6.2 GiB used, 5.5 TiB / 5.5 TiB avail; 136 MiB/s rd, 189 MiB/s wr, 15.27k op/s 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:30:26] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:30:26.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:30:26.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: states { 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: grp_id: 3 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: state: OPTIMIZED 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: } 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: ], , client address: IPv4 10.20.193.155:54098 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.649617] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000224 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.665592] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000272 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.681696] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000348 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.697685] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000304 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.713868] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000509 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.744883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000275 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.760463] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000275 seconds 2026-02-18T03:30:26.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.776505] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000317 seconds 2026-02-18T03:30:26.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.792557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000333 seconds 2026-02-18T03:30:26.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.808539] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000306 seconds 2026-02-18T03:30:26.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.832548] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000294 seconds 2026-02-18T03:30:26.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.872558] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000301 seconds 2026-02-18T03:30:27.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:26 trial034 ceph-mon[21825]: pgmap v220: 33 pgs: 33 active+clean; 15 GiB data, 6.2 GiB used, 5.5 TiB / 5.5 TiB avail; 136 MiB/s rd, 189 MiB/s wr, 15.27k op/s 2026-02-18T03:30:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:28 trial155 ceph-mon[24719]: pgmap v221: 33 pgs: 33 active+clean; 15 GiB data, 7.1 GiB used, 5.5 TiB / 5.5 TiB avail; 133 MiB/s rd, 177 MiB/s wr, 13.98k op/s 2026-02-18T03:30:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2928260208' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/476396479' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:28 trial034 ceph-mon[21825]: pgmap v221: 33 pgs: 33 active+clean; 15 GiB data, 7.1 GiB used, 5.5 TiB / 5.5 TiB avail; 133 MiB/s rd, 177 MiB/s wr, 13.98k op/s 2026-02-18T03:30:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2928260208' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/476396479' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:30 trial155 ceph-mon[24719]: pgmap v222: 33 pgs: 33 active+clean; 15 GiB data, 7.7 GiB used, 5.5 TiB / 5.5 TiB avail; 134 MiB/s rd, 171 MiB/s wr, 12.45k op/s 2026-02-18T03:30:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:30 trial034 ceph-mon[21825]: pgmap v222: 33 pgs: 33 active+clean; 15 GiB data, 7.7 GiB used, 5.5 TiB / 5.5 TiB avail; 134 MiB/s rd, 171 MiB/s wr, 12.45k op/s 2026-02-18T03:30:31.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:31.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 662.20 9.2M 9.2M 0.0k 91.8M 92.0M 0.0k nvme12n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 660.80 9.2M 9.2M 0.0k 91.8M 92.2M 0.0k nvme16n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 660.30 9.3M 9.5M 0.0k 93.1M 95.2M 0.0k nvme20n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 641.60 8.8M 9.1M 0.0k 88.0M 90.9M 0.0k nvme24n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 669.60 9.1M 9.5M 0.0k 90.6M 94.8M 0.0k nvme28n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 677.10 9.5M 9.3M 0.0k 94.7M 92.7M 0.0k nvme32n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 676.70 9.6M 9.4M 0.0k 95.8M 93.9M 0.0k nvme36n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 648.90 9.3M 9.2M 0.0k 93.1M 91.8M 0.0k nvme40n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 650.40 9.0M 9.3M 0.0k 89.9M 92.8M 0.0k nvme44n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 665.70 9.4M 9.1M 0.0k 94.0M 91.5M 0.0k nvme48n3 2026-02-18T03:30:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 653.40 9.2M 9.4M 0.0k 92.0M 94.2M 0.0k nvme4n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 650.40 8.8M 9.1M 0.0k 88.0M 91.1M 0.0k nvme52n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 662.40 9.4M 9.1M 0.0k 93.6M 90.8M 0.0k nvme56n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 668.50 9.5M 9.4M 0.0k 95.0M 94.1M 0.0k nvme60n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 653.50 9.3M 9.2M 0.0k 93.3M 91.7M 0.0k nvme64n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 664.20 9.1M 9.4M 0.0k 90.7M 93.9M 0.0k nvme8n3 2026-02-18T03:30:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:32 trial155 ceph-mon[24719]: pgmap v223: 33 pgs: 33 active+clean; 15 GiB data, 8.6 GiB used, 5.5 TiB / 5.5 TiB avail; 145 MiB/s rd, 178 MiB/s wr, 12.75k op/s 2026-02-18T03:30:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:32 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1196517284' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:32 trial034 ceph-mon[21825]: pgmap v223: 33 pgs: 33 active+clean; 15 GiB data, 8.6 GiB used, 5.5 TiB / 5.5 TiB avail; 145 MiB/s rd, 178 MiB/s wr, 12.75k op/s 2026-02-18T03:30:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1196517284' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:34 trial155 ceph-mon[24719]: pgmap v224: 33 pgs: 33 active+clean; 15 GiB data, 9.7 GiB used, 5.5 TiB / 5.5 TiB avail; 138 MiB/s rd, 163 MiB/s wr, 11.65k op/s 2026-02-18T03:30:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:34 trial034 ceph-mon[21825]: pgmap v224: 33 pgs: 33 active+clean; 15 GiB data, 9.7 GiB used, 5.5 TiB / 5.5 TiB avail; 138 MiB/s rd, 163 MiB/s wr, 11.65k op/s 2026-02-18T03:30:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/667894772' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1886978598' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/667894772' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1886978598' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:36 trial155 ceph-mon[24719]: pgmap v225: 33 pgs: 33 active+clean; 16 GiB data, 11 GiB used, 5.5 TiB / 5.5 TiB avail; 131 MiB/s rd, 151 MiB/s wr, 11k op/s 2026-02-18T03:30:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:36 trial034 ceph-mon[21825]: pgmap v225: 33 pgs: 33 active+clean; 16 GiB data, 11 GiB used, 5.5 TiB / 5.5 TiB avail; 131 MiB/s rd, 151 MiB/s wr, 11k op/s 2026-02-18T03:30:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:38 trial155 ceph-mon[24719]: pgmap v226: 33 pgs: 33 active+clean; 16 GiB data, 11 GiB used, 5.5 TiB / 5.5 TiB avail; 112 MiB/s rd, 127 MiB/s wr, 9.42k op/s 2026-02-18T03:30:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:38 trial034 ceph-mon[21825]: pgmap v226: 33 pgs: 33 active+clean; 16 GiB data, 11 GiB used, 5.5 TiB / 5.5 TiB avail; 112 MiB/s rd, 127 MiB/s wr, 9.42k op/s 2026-02-18T03:30:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:39 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1861241246' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:40.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1861241246' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:40 trial155 ceph-mon[24719]: pgmap v227: 33 pgs: 33 active+clean; 16 GiB data, 12 GiB used, 5.5 TiB / 5.5 TiB avail; 102 MiB/s rd, 114 MiB/s wr, 8.62k op/s 2026-02-18T03:30:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:40 trial034 ceph-mon[21825]: pgmap v227: 33 pgs: 33 active+clean; 16 GiB data, 12 GiB used, 5.5 TiB / 5.5 TiB avail; 102 MiB/s rd, 114 MiB/s wr, 8.62k op/s 2026-02-18T03:30:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:41.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:30:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 493.50 6.1M 6.3M 0.0k 61.2M 62.6M 0.0k nvme12n3 2026-02-18T03:30:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 484.80 6.0M 6.3M 0.0k 60.4M 63.0M 0.0k nvme16n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 478.20 6.0M 6.4M 0.0k 59.8M 63.6M 0.0k nvme20n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 499.80 6.6M 6.3M 0.0k 66.1M 62.9M 0.0k nvme24n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 507.00 6.4M 6.4M 0.0k 64.2M 63.6M 0.0k nvme28n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 505.00 6.4M 6.3M 0.0k 63.9M 62.5M 0.0k nvme32n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 502.00 6.4M 6.3M 0.0k 63.6M 62.6M 0.0k nvme36n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 497.00 6.3M 6.4M 0.0k 63.0M 63.6M 0.0k nvme40n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 499.90 6.6M 6.2M 0.0k 65.9M 62.4M 0.0k nvme44n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 513.40 6.6M 6.3M 0.0k 65.6M 63.3M 0.0k nvme48n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 476.90 6.1M 6.3M 0.0k 60.9M 62.9M 0.0k nvme4n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 490.60 6.3M 6.2M 0.0k 63.3M 61.9M 0.0k nvme52n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 482.90 6.2M 6.4M 0.0k 61.8M 64.0M 0.0k nvme56n3 2026-02-18T03:30:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 495.00 6.2M 6.3M 0.0k 61.8M 62.7M 0.0k nvme60n3 2026-02-18T03:30:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 492.70 6.2M 6.2M 0.0k 61.8M 62.3M 0.0k nvme64n3 2026-02-18T03:30:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 500.60 6.3M 6.3M 0.0k 62.9M 62.7M 0.0k nvme8n3 2026-02-18T03:30:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:42 trial155 ceph-mon[24719]: pgmap v228: 33 pgs: 33 active+clean; 16 GiB data, 12 GiB used, 5.5 TiB / 5.5 TiB avail; 105 MiB/s rd, 118 MiB/s wr, 9.00k op/s 2026-02-18T03:30:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3255907997' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2474358362' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:42 trial034 ceph-mon[21825]: pgmap v228: 33 pgs: 33 active+clean; 16 GiB data, 12 GiB used, 5.5 TiB / 5.5 TiB avail; 105 MiB/s rd, 118 MiB/s wr, 9.00k op/s 2026-02-18T03:30:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3255907997' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2474358362' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:44 trial155 ceph-mon[24719]: pgmap v229: 33 pgs: 33 active+clean; 16 GiB data, 13 GiB used, 5.5 TiB / 5.5 TiB avail; 99 MiB/s rd, 110 MiB/s wr, 8.58k op/s 2026-02-18T03:30:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:44 trial034 ceph-mon[21825]: pgmap v229: 33 pgs: 33 active+clean; 16 GiB data, 13 GiB used, 5.5 TiB / 5.5 TiB avail; 99 MiB/s rd, 110 MiB/s wr, 8.58k op/s 2026-02-18T03:30:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:46 trial155 ceph-mon[24719]: pgmap v230: 33 pgs: 33 active+clean; 16 GiB data, 14 GiB used, 5.5 TiB / 5.5 TiB avail; 94 MiB/s rd, 104 MiB/s wr, 8.28k op/s 2026-02-18T03:30:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:46 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1073856178' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:46 trial034 ceph-mon[21825]: pgmap v230: 33 pgs: 33 active+clean; 16 GiB data, 14 GiB used, 5.5 TiB / 5.5 TiB avail; 94 MiB/s rd, 104 MiB/s wr, 8.28k op/s 2026-02-18T03:30:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1073856178' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:48 trial155 ceph-mon[24719]: pgmap v231: 33 pgs: 33 active+clean; 16 GiB data, 14 GiB used, 5.5 TiB / 5.5 TiB avail; 81 MiB/s rd, 89 MiB/s wr, 7.23k op/s 2026-02-18T03:30:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:48 trial034 ceph-mon[21825]: pgmap v231: 33 pgs: 33 active+clean; 16 GiB data, 14 GiB used, 5.5 TiB / 5.5 TiB avail; 81 MiB/s rd, 89 MiB/s wr, 7.23k op/s 2026-02-18T03:30:50.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:49 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2746407080' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:50.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:49 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3761939703' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2746407080' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3761939703' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:50 trial155 ceph-mon[24719]: pgmap v232: 33 pgs: 33 active+clean; 16 GiB data, 15 GiB used, 5.5 TiB / 5.5 TiB avail; 74 MiB/s rd, 81 MiB/s wr, 6.67k op/s 2026-02-18T03:30:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:50 trial034 ceph-mon[21825]: pgmap v232: 33 pgs: 33 active+clean; 16 GiB data, 15 GiB used, 5.5 TiB / 5.5 TiB avail; 74 MiB/s rd, 81 MiB/s wr, 6.67k op/s 2026-02-18T03:30:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 411.20 4.9M 4.8M 0.0k 48.8M 48.0M 0.0k nvme12n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 409.70 5.0M 4.9M 0.0k 49.9M 48.9M 0.0k nvme16n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 409.00 4.9M 4.9M 0.0k 48.8M 48.8M 0.0k nvme20n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 402.80 4.9M 4.6M 0.0k 49.4M 46.0M 0.0k nvme24n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 405.90 4.6M 4.7M 0.0k 45.5M 46.7M 0.0k nvme28n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 400.30 4.9M 5.0M 0.0k 48.6M 49.6M 0.0k nvme32n3 2026-02-18T03:30:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 407.80 4.8M 4.8M 0.0k 48.5M 48.0M 0.0k nvme36n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 395.30 4.8M 4.7M 0.0k 47.7M 47.4M 0.0k nvme40n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 408.00 4.7M 4.8M 0.0k 47.2M 48.2M 0.0k nvme44n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 414.60 5.0M 4.9M 0.0k 50.0M 48.9M 0.0k nvme48n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 392.50 4.7M 4.8M 0.0k 46.6M 47.6M 0.0k nvme4n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 394.20 4.6M 4.7M 0.0k 45.9M 46.9M 0.0k nvme52n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 400.90 4.7M 4.7M 0.0k 47.3M 47.4M 0.0k nvme56n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 402.20 4.8M 4.8M 0.0k 48.1M 48.0M 0.0k nvme60n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 391.40 4.6M 4.6M 0.0k 45.8M 46.3M 0.0k nvme64n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 412.50 4.9M 4.8M 0.0k 49.3M 47.6M 0.0k nvme8n3 2026-02-18T03:30:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:30:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:52 trial155 ceph-mon[24719]: pgmap v233: 33 pgs: 33 active+clean; 16 GiB data, 15 GiB used, 5.5 TiB / 5.5 TiB avail; 78 MiB/s rd, 85 MiB/s wr, 7.07k op/s 2026-02-18T03:30:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:52 trial034 ceph-mon[21825]: pgmap v233: 33 pgs: 33 active+clean; 16 GiB data, 15 GiB used, 5.5 TiB / 5.5 TiB avail; 78 MiB/s rd, 85 MiB/s wr, 7.07k op/s 2026-02-18T03:30:54.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:53 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1609139067' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:54.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1609139067' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:54 trial155 ceph-mon[24719]: pgmap v234: 33 pgs: 33 active+clean; 16 GiB data, 16 GiB used, 5.5 TiB / 5.5 TiB avail; 75 MiB/s rd, 82 MiB/s wr, 6.86k op/s 2026-02-18T03:30:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:54 trial034 ceph-mon[21825]: pgmap v234: 33 pgs: 33 active+clean; 16 GiB data, 16 GiB used, 5.5 TiB / 5.5 TiB avail; 75 MiB/s rd, 82 MiB/s wr, 6.86k op/s 2026-02-18T03:30:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:56 trial155 ceph-mon[24719]: pgmap v235: 33 pgs: 33 active+clean; 16 GiB data, 16 GiB used, 5.5 TiB / 5.5 TiB avail; 68 MiB/s rd, 73 MiB/s wr, 6.24k op/s 2026-02-18T03:30:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:56 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/597255462' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:56 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1091740157' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:56 trial034 ceph-mon[21825]: pgmap v235: 33 pgs: 33 active+clean; 16 GiB data, 16 GiB used, 5.5 TiB / 5.5 TiB avail; 68 MiB/s rd, 73 MiB/s wr, 6.24k op/s 2026-02-18T03:30:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/597255462' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1091740157' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:30:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:30:58 trial155 ceph-mon[24719]: pgmap v236: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 6.03k op/s 2026-02-18T03:30:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:30:58 trial034 ceph-mon[21825]: pgmap v236: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 6.03k op/s 2026-02-18T03:31:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:00 trial155 ceph-mon[24719]: pgmap v237: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.62k op/s 2026-02-18T03:31:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:00 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3393245943' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:00 trial034 ceph-mon[21825]: pgmap v237: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.62k op/s 2026-02-18T03:31:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:00 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3393245943' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 354.00 3.9M 3.9M 0.0k 39.2M 38.9M 0.0k nvme12n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 341.90 3.7M 3.9M 0.0k 36.9M 38.6M 0.0k nvme16n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 344.00 3.9M 3.8M 0.0k 39.4M 38.5M 0.0k nvme20n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 345.00 3.8M 3.8M 0.0k 38.4M 37.7M 0.0k nvme24n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 351.90 4.0M 3.9M 0.0k 40.4M 39.0M 0.0k nvme28n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 356.00 3.9M 4.0M 0.0k 39.2M 39.9M 0.0k nvme32n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 338.30 3.7M 3.9M 0.0k 36.9M 38.6M 0.0k nvme36n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 338.20 3.8M 3.9M 0.0k 37.8M 39.4M 0.0k nvme40n3 2026-02-18T03:31:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 349.70 4.0M 3.9M 0.0k 39.9M 38.6M 0.0k nvme44n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 355.90 4.1M 4.0M 0.0k 41.1M 40.1M 0.0k nvme48n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 343.00 3.8M 3.9M 0.0k 38.5M 39.3M 0.0k nvme4n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 342.00 3.9M 3.9M 0.0k 38.7M 39.5M 0.0k nvme52n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 347.90 4.0M 3.9M 0.0k 39.7M 38.6M 0.0k nvme56n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 350.10 4.1M 4.0M 0.0k 40.6M 39.7M 0.0k nvme60n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 343.60 3.8M 4.0M 0.0k 37.9M 40.2M 0.0k nvme64n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 347.70 3.8M 3.8M 0.0k 38.0M 37.7M 0.0k nvme8n3 2026-02-18T03:31:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:02 trial155 ceph-mon[24719]: pgmap v238: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.99k op/s 2026-02-18T03:31:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:02 trial034 ceph-mon[21825]: pgmap v238: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.99k op/s 2026-02-18T03:31:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:03 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1984487665' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:03 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2991429694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1984487665' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2991429694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:31:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:31:04.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:31:05.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:04 trial155 ceph-mon[24719]: pgmap v239: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:31:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:04 trial034 ceph-mon[21825]: pgmap v239: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:31:05.639 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:31:07.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:06 trial155 ceph-mon[24719]: pgmap v240: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:31:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:06 trial034 ceph-mon[21825]: pgmap v240: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:31:08.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:07 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1749204676' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:08.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1749204676' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:08 trial155 ceph-mon[24719]: pgmap v241: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.77k op/s 2026-02-18T03:31:09.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:08 trial034 ceph-mon[21825]: pgmap v241: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.77k op/s 2026-02-18T03:31:10.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:09 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:09 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:11.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: pgmap v242: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 50 MiB/s rd, 54 MiB/s wr, 4.90k op/s 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/776067318' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:11.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/682921108' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: pgmap v242: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 50 MiB/s rd, 54 MiB/s wr, 4.90k op/s 2026-02-18T03:31:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/776067318' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/682921108' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:11.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 304.90 3.2M 3.3M 0.0k 31.6M 32.9M 0.0k nvme12n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 309.20 3.4M 3.3M 0.0k 33.9M 33.4M 0.0k nvme16n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 313.30 3.3M 3.2M 0.0k 33.0M 31.9M 0.0k nvme20n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 305.30 3.3M 3.3M 0.0k 33.0M 33.3M 0.0k nvme24n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 311.00 3.2M 3.2M 0.0k 32.3M 32.3M 0.0k nvme28n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 319.00 3.4M 3.4M 0.0k 34.3M 34.4M 0.0k nvme32n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 314.90 3.4M 3.4M 0.0k 34.1M 34.1M 0.0k nvme36n3 2026-02-18T03:31:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 308.50 3.2M 3.4M 0.0k 32.1M 33.5M 0.0k nvme40n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 310.10 3.5M 3.2M 0.0k 35.0M 32.5M 0.0k nvme44n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 307.20 3.1M 3.3M 0.0k 31.4M 33.2M 0.0k nvme48n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 299.80 3.1M 3.3M 0.0k 31.0M 33.3M 0.0k nvme4n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 308.30 3.4M 3.2M 0.0k 34.1M 32.0M 0.0k nvme52n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 310.30 3.2M 3.2M 0.0k 32.2M 31.7M 0.0k nvme56n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 303.50 3.3M 3.2M 0.0k 32.7M 32.4M 0.0k nvme60n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 307.30 3.4M 3.3M 0.0k 33.7M 32.8M 0.0k nvme64n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 313.70 3.5M 3.3M 0.0k 35.4M 33.3M 0.0k nvme8n3 2026-02-18T03:31:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:12 trial034 ceph-mon[21825]: pgmap v243: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.27k op/s 2026-02-18T03:31:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:12 trial155 ceph-mon[24719]: pgmap v243: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.27k op/s 2026-02-18T03:31:15.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:14 trial034 ceph-mon[21825]: pgmap v244: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:31:15.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1395795013' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:14 trial155 ceph-mon[24719]: pgmap v244: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:31:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:14 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1395795013' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:16 trial034 ceph-mon[21825]: pgmap v245: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 4.78k op/s 2026-02-18T03:31:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:16 trial155 ceph-mon[24719]: pgmap v245: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 4.78k op/s 2026-02-18T03:31:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1104817348' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1964944814' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1104817348' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1964944814' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:18 trial034 ceph-mon[21825]: pgmap v246: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.16k op/s 2026-02-18T03:31:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:18 trial155 ceph-mon[24719]: pgmap v246: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.16k op/s 2026-02-18T03:31:21.042 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #1: thrashed- nvmeof.a (by ceph_daemon_stop); nvmeof.b, nvmeof.c (by daemon_remove); 2026-02-18T03:31:21.043 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:31:21.043 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout: Active: inactive (dead) since Wed 2026-02-18 03:29:48 UTC; 1min 32s ago 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout: Duration: 2min 51.231s 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout: Process: 54329 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.075 INFO:teuthology.orchestra.run.trial034.stdout: Process: 54330 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: Process: 79329 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: Process: 79548 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: Process: 79583 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 54917 (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 11min 30.825s 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:31:21.076 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[54917]: [18-Feb-2026 03:29:48] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 podman[79365]: 2026-02-18 03:29:48.789687652 +0000 UTC m=+0.609698450 container died b5ceeeca2d24004572f04b71e104deced54bb98701a62e8926fa751e576fa6ed (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.buildah.version=1.29.0, io.ceph.git.branch=devel, io.openshift.wants=ceph,rbd, io.ceph.nvmeof=, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.spdk.build.target-arch=x86-64-v2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, distribution-scope=public, io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=, io.spdk.version=25.09, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, architecture=x86_64, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.ceph.component=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-type=git, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers ) 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 podman[79365]: 2026-02-18 03:29:48.802589103 +0000 UTC m=+0.622599901 container remove b5ceeeca2d24004572f04b71e104deced54bb98701a62e8926fa751e576fa6ed (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.summary=Ceph NVMe over Fabrics Gateway, version=1.6.5, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, io.spdk.build.makeflags=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.spdk.build.target-arch=x86-64-v2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, release=, vcs-type=git, com.redhat.component=ubi9-container, io.ceph.nvmeof=, io.spdk.git.branch=undefined, io.openshift.wants=ceph,rbd, distribution-scope=public, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.version=25.09, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0) 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 bash[79365]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:31:21.077 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:29:48 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 11min 30.825s CPU time. 2026-02-18T03:31:21.078 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:31:21.078 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:31:21.112 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:21.112 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:31:21.112 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:30:05 UTC; 1min 16s ago 2026-02-18T03:31:21.112 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62368 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.112 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62369 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 62448 (conmon) 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 317.9M (peak: 320.7M) 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 4min 57.038s 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62450 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62452 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62545 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62983 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: │ └─62988 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: └─62448 /usr/bin/conmon --api-version 1 -c 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 -u 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata -p /run/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 3 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:21.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:30:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:37414 2026-02-18T03:31:21.114 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:30:09 UTC; 1min 11s ago 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64083 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64084 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 64163 (conmon) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 318.4M (peak: 320.3M) 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 4min 37.223s 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64165 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64167 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64259 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64624 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: │ └─64629 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: └─64163 /usr/bin/conmon --api-version 1 -c 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb -u 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata -p /run/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.681696] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000348 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.697685] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000304 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.713868] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000509 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.744883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000275 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.760463] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000275 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.776505] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000317 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.792557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000333 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.808539] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000306 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.832548] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000294 seconds 2026-02-18T03:31:21.153 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.872558] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000301 seconds 2026-02-18T03:31:21.155 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:26:45 UTC; 4min 36s ago 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Process: 25391 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Process: 25392 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 25702 (conmon) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 1.4G (peak: 1.5G) 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 17min 44.548s 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25704 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25706 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25727 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:31:21.185 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─26138 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:31:21.186 INFO:teuthology.orchestra.run.trial177.stdout: │ └─26143 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:31:21.186 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:31:21.186 INFO:teuthology.orchestra.run.trial177.stdout: └─25702 /usr/bin/conmon --api-version 1 -c 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 -u 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata -p /run/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 2026-02-18T03:31:21.186 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:31:21.187 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.632479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000217 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.648479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000185 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.664471] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000207 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.680450] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000194 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.696451] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000182 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.712483] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000227 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:30:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [2026-02-18 03:30:15.728479] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000219 seconds 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:31:21.188 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:04] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:31:21.189 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:31:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:20 trial034 ceph-mon[21825]: pgmap v247: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 4.39k op/s 2026-02-18T03:31:21.411 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:31:21.411 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 92s ago 6m trial034=x;count:1 2026-02-18T03:31:21.411 INFO:teuthology.orchestra.run.trial177.stdout:mon 2/3 92s ago 6m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:31:21.411 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 3/4 4m ago 4m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:31:21.411 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 92s ago 5m trial155 2026-02-18T03:31:21.420 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:31:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:20 trial155 ceph-mon[24719]: pgmap v247: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 4.39k op/s 2026-02-18T03:31:21.605 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:31:21.605 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 stopped 92s ago 4m - - 2026-02-18T03:31:21.606 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (76s) 73s ago 76s 152M - 1.6.5 99a57256b38c 4cd4a5649af8 2026-02-18T03:31:21.606 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (72s) 71s ago 72s 54.6M - 1.6.5 99a57256b38c 7f7bbf3f011b 2026-02-18T03:31:21.606 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (4m) 4m ago 4m 57.7M - 1.6.5 99a57256b38c 14e1b8d88b2e 2026-02-18T03:31:21.614 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:31:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:21.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 287.20 3.0M 2.9M 0.0k 30.4M 29.2M 0.0k nvme12n3 2026-02-18T03:31:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 276.70 2.7M 2.9M 0.0k 27.1M 29.3M 0.0k nvme16n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 277.50 2.9M 2.9M 0.0k 28.9M 28.8M 0.0k nvme20n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 275.60 2.9M 2.8M 0.0k 29.1M 28.2M 0.0k nvme24n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 273.60 2.8M 2.8M 0.0k 28.1M 28.2M 0.0k nvme28n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 283.30 2.9M 2.9M 0.0k 28.9M 29.3M 0.0k nvme32n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 282.00 3.0M 2.9M 0.0k 30.0M 28.9M 0.0k nvme36n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 280.00 2.9M 2.8M 0.0k 29.5M 28.1M 0.0k nvme40n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 279.60 2.9M 2.8M 0.0k 29.4M 28.2M 0.0k nvme44n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 279.50 2.8M 3.0M 0.0k 28.2M 30.1M 0.0k nvme48n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 276.50 2.8M 2.9M 0.0k 28.4M 28.7M 0.0k nvme4n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 277.70 2.8M 2.8M 0.0k 27.8M 27.7M 0.0k nvme52n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 270.00 2.7M 2.9M 0.0k 27.4M 28.6M 0.0k nvme56n3 2026-02-18T03:31:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 273.10 2.8M 2.8M 0.0k 28.4M 28.2M 0.0k nvme60n3 2026-02-18T03:31:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 277.20 2.8M 2.9M 0.0k 28.4M 29.1M 0.0k nvme64n3 2026-02-18T03:31:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 279.10 2.9M 2.8M 0.0k 28.9M 27.9M 0.0k nvme8n3 2026-02-18T03:31:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:21.835 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,c; 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:21.836 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:31:21.836 INFO:teuthology.orchestra.run.trial177.stdout: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:31:21.836 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:21.836 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:31:21.845 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:31:22.065 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,c 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c (age 77s) [leader: a], out of quorum: b 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 6m) 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 3 gateways active (3 hosts) 2026-02-18T03:31:22.066 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: usage: 21 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: client: 47 MiB/s rd, 49 MiB/s wr, 2.38k op/s rd, 2.35k op/s wr 2026-02-18T03:31:22.067 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:31:22.075 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:31:22.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/500939798' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:22.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1417103503' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:31:22.317 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:31:22.317 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 114, 2026-02-18T03:31:22.317 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 4, 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 30, 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:31:22.318 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:31:22.319 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:31:22.320 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:31:22.321 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:31:22.326 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.384 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.385 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.386 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.387 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.388 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:31:22.391 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:31:22.437 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.439 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:31:22.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/500939798' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:22.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/1417103503' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:31:22.484 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.485 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:31:22.529 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.530 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:31:22.574 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.575 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:31:22.620 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.621 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:31:22.665 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.666 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:31:22.751 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.753 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:31:22.797 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.798 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:31:22.842 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.843 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:31:22.888 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.889 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:31:22.934 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.935 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:31:22.980 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:22.981 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:31:23.025 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.026 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:31:23.070 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.071 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:31:23.115 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.116 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:31:23.160 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.161 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:31:23.206 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.207 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:31:23.252 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.253 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:31:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:22 trial034 ceph-mon[21825]: from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:22 trial034 ceph-mon[21825]: from='client.38304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:22 trial034 ceph-mon[21825]: pgmap v248: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 4.72k op/s 2026-02-18T03:31:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4018243036' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:31:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3315737575' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:31:23.298 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.300 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:31:23.344 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.345 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:31:23.390 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.391 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:31:23.435 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.436 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:31:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:22 trial155 ceph-mon[24719]: from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:22 trial155 ceph-mon[24719]: from='client.38304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:22 trial155 ceph-mon[24719]: pgmap v248: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 4.72k op/s 2026-02-18T03:31:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/4018243036' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:31:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:22 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3315737575' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:31:23.520 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.521 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:31:23.566 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.566 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:31:23.611 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.612 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:31:23.657 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.658 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:31:23.702 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.703 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:31:23.747 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.748 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:31:23.792 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.794 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:31:23.839 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.839 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:31:23.882 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.884 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:31:23.968 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:23.969 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:31:24.014 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.015 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:31:24.061 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.061 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:31:24.107 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.108 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:31:24.153 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.153 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:31:24.198 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.199 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:31:24.243 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.244 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:31:24.290 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.290 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:31:24.336 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.337 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:31:24.382 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.383 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:31:24.427 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.428 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:31:24.472 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.474 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:31:24.518 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.519 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:31:24.563 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.564 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:31:24.609 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.610 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:31:24.655 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.656 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:31:24.700 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.701 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:31:24.746 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.747 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:31:24.790 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.791 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:31:24.838 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.839 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:31:24.883 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.884 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:31:24.929 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.931 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:31:24.976 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:24.977 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:31:25.022 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.022 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:31:25.067 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.068 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:31:25.112 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.113 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:31:25.157 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.159 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:31:25.203 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.204 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:31:25.248 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.249 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:31:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:24 trial034 ceph-mon[21825]: pgmap v249: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 4.69k op/s 2026-02-18T03:31:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2408016940' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2131893615' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:25.293 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.294 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:31:25.339 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.340 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:31:25.385 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.386 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:31:25.430 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:31:25.431 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:31:25.431 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:31:25.432 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.a 2026-02-18T03:31:25.432 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon restart nvmeof.nvmeof.a --force 2026-02-18T03:31:25.432 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:31:25.432 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.b 2026-02-18T03:31:25.432 INFO:tasks.cephadm.mon.c:Restarting mon.b (starting--it wasn't running)... 2026-02-18T03:31:25.433 DEBUG:teuthology.orchestra.run.trial086:mon.b> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service 2026-02-18T03:31:25.436 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b 2026-02-18T03:31:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:24 trial155 ceph-mon[24719]: pgmap v249: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 4.69k op/s 2026-02-18T03:31:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:24 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/2408016940' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:24 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2131893615' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:25.631 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to restart nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:31:25.641 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.b 2026-02-18T03:31:25.641 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon start nvmeof.nvmeof.b 2026-02-18T03:31:25.660 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:31:25.660 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:31:25.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 systemd[1]: Starting Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 podman[73185]: 2026-02-18 03:31:25.621666961 +0000 UTC m=+0.017855049 container create 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, OSD_FLAVOR=debug, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 podman[73185]: 2026-02-18 03:31:25.649618573 +0000 UTC m=+0.045806661 container init 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, OSD_FLAVOR=debug, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, io.buildah.version=1.33.7) 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 podman[73185]: 2026-02-18 03:31:25.652557407 +0000 UTC m=+0.048745495 container start 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7) 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 bash[73185]: 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 podman[73185]: 2026-02-18 03:31:25.61499744 +0000 UTC m=+0.011185528 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 systemd[1]: Started Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pidfile_write: ignore empty --pid-file 2026-02-18T03:31:25.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: load: jerasure load: lrc 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Git sha 0 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: DB SUMMARY 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: DB Session ID: S5P8TD7QTQ1UNPTIKOKJ 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: MANIFEST file: MANIFEST-000010 size: 654 Bytes 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000018.sst 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000016.log size: 3372279 ; 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:31:25.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.env: 0x5581c86e0100 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.info_log: 0x5581cef2bb00 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.statistics: (nil) 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.use_fsync: 0 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:31:25.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.db_log_dir: 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.wal_dir: 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:31:25.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.write_buffer_manager: 0x5581cef2eb40 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:31:25.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.unordered_write: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.row_cache: None 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.wal_filter: None 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:31:25.880 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.wal_compression: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:31:25.881 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:31:25.882 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_open_files: -1 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Compression algorithms supported: 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kZSTD supported: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:31:25.883 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.merge_operator: 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_filter: None 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:31:25.884 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5581cef2a240) 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: index_type: 0 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: data_block_index_type: 0 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: index_shortening: 1 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: checksum: 4 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: no_block_cache: 0 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache: 0x5581cef4bb90 2026-02-18T03:31:25.885 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_options: 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: capacity : 536870912 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: num_shard_bits : 4 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: strict_capacity_limit : 0 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_compressed: (nil) 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: persistent_cache: (nil) 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: block_size: 4096 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: block_size_deviation: 10 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: block_restart_interval: 16 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: index_block_restart_interval: 1 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: metadata_block_size: 4096 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: partition_filters: 0 2026-02-18T03:31:25.886 INFO:journalctl@ceph.mon.b.trial086.stdout: use_delta_encoding: 1 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: filter_policy: bloomfilter 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: whole_key_filtering: 1 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: verify_compression: 0 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: format_version: 5 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_index_compression: 1 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: block_align: 0 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: max_auto_readahead_size: 262144 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: prepopulate_block_cache: 0 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:31:25.887 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression: NoCompression 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.num_levels: 7 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:31:25.888 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:31:25.889 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:31:25.890 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:31:25.891 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:31:25.892 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.ttl: 2592000 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:31:25.893 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 20, last_sequence is 7623, log_number is 16,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 16 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 16 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43e7e096-cb3c-4269-9323-0b4ac0e3cc86 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385485687894, "job": 1, "event": "recovery_started", "wal_files": [16]} 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #16 mode 2 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385485694424, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 2218116, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 7628, "largest_seqno": 9134, "table_properties": {"data_size": 2210518, "index_size": 5210, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1349, "raw_key_size": 10988, "raw_average_key_size": 20, "raw_value_size": 2197791, "raw_average_value_size": 4162, "num_data_blocks": 243, "num_entries": 528, "num_filter_entries": 528, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771385485, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43e7e096-cb3c-4269-9323-0b4ac0e3cc86", "db_session_id": "S5P8TD7QTQ1UNPTIKOKJ", "orig_file_number": 21, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:31:25.894 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385485694498, "job": 1, "event": "recovery_finished"} 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:5047] Creating manifest 23 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000016.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5581cef4e700 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: DB pointer 0x5581cef60000 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: ** DB Stats ** 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:31:25.895 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: ** Compaction Stats [default] ** 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: L0 1/0 2.12 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: L6 1/0 4.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: Sum 2/0 6.93 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.896 INFO:journalctl@ceph.mon.b.trial086.stdout: ** Compaction Stats [default] ** 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 713.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: Flush(GB): cumulative 0.002, interval 0.002 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:31:25.897 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative compaction: 0.00 GB write, 235.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval compaction: 0.00 GB write, 235.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: Block cache BinnedLRUCache@0x5581cef4bb90#2 capacity: 512.00 MB usage: 7.49 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000269711%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: starting mon.b rank 2 at public addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] at bind addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).mds e1 new map 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).mds e1 print_map 2026-02-18T03:31:25.898 INFO:journalctl@ceph.mon.b.trial086.stdout: e1 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: legacy client fscid: -1 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout: No filesystems configured 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).osd e51 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:31:25.899 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: mon.b@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2026-02-18T03:31:25.905 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":81,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:31:25.944 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to start nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:31:25.956 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.c 2026-02-18T03:31:25.957 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon start nvmeof.nvmeof.c 2026-02-18T03:31:26.257 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to start nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:31:26.270 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 76 secs before thrashing 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 systemd[1]: Starting Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 podman[80941]: 2026-02-18 03:31:26.125008258 +0000 UTC m=+0.020059021 container create fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.nvmeof=, io.spdk.build.makeflags=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, io.buildah.version=1.29.0, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vendor=Red Hat, Inc., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, url=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, io.ceph.component=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.ceph.version=1.6.5, architecture=x86_64, io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, io.ceph.maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2) 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 podman[80941]: 2026-02-18 03:31:26.158097079 +0000 UTC m=+0.053147802 container init fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, name=ceph-nvmeof, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , vendor=Red Hat, Inc., io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-type=git, io.buildah.version=1.29.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.version=9.0-30.el9, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , io.ceph.nvmeof=, build-date=2026-02-11 09:53:49 UTC, io.openshift.wants=ceph,rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.component=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, version=1.6.5, io.spdk.build.makeflags=, io.spdk.git.branch=undefined, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 podman[80941]: 2026-02-18 03:31:26.160553339 +0000 UTC m=+0.055604052 container start fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, maintainer=Ceph Developers , url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, vcs-type=git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, vendor=Red Hat, Inc., version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.spdk.version=25.09, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, io.spdk.build.makeflags=, io.ceph.maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, name=ceph-nvmeof, io.ceph.version=1.6.5, io.ceph.nvmeof=, architecture=x86_64, org.centos.version=9.0-30.el9, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, release=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel) 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 bash[80941]: fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 podman[80941]: 2026-02-18 03:31:26.117034004 +0000 UTC m=+0.012084737 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:31:26.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 systemd[1]: Started Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:31:26.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:31:26.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a, using rotation 2026-02-18T03:31:26.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:31:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v236: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 65 MiB/s rd, 70 MiB/s wr, 6.03k op/s 2026-02-18T03:31:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v237: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 65 MiB/s wr, 5.62k op/s 2026-02-18T03:31:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3393245943' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v238: 33 pgs: 33 active+clean; 16 GiB data, 17 GiB used, 5.5 TiB / 5.5 TiB avail; 63 MiB/s rd, 69 MiB/s wr, 5.99k op/s 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1984487665' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2991429694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v239: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 62 MiB/s rd, 66 MiB/s wr, 5.88k op/s 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v240: 33 pgs: 33 active+clean; 16 GiB data, 18 GiB used, 5.5 TiB / 5.5 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 5.37k op/s 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1749204676' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v241: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 60 MiB/s rd, 63 MiB/s wr, 5.77k op/s 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v242: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 50 MiB/s rd, 54 MiB/s wr, 4.90k op/s 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/776067318' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/682921108' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v243: 33 pgs: 33 active+clean; 16 GiB data, 19 GiB used, 5.5 TiB / 5.5 TiB avail; 54 MiB/s rd, 57 MiB/s wr, 5.27k op/s 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v244: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 56 MiB/s wr, 5.22k op/s 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1395795013' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v245: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 4.78k op/s 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1104817348' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1964944814' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v246: 33 pgs: 33 active+clean; 16 GiB data, 20 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 54 MiB/s wr, 5.16k op/s 2026-02-18T03:31:26.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v247: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 4.39k op/s 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/500939798' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1417103503' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.38304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v248: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 4.72k op/s 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4018243036' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3315737575' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: pgmap v249: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 4.69k op/s 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2408016940' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2131893615' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:26.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:31:26.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:31:26.637 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [gateway] 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): name = client.nvmeof.nvmeof.a 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): port = 5500 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:31:26.638 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:31:26.639 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:31:26.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:31:26.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): force_tls = False 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:31:26.642 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:31:26.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.643 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [discovery] 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): port = 8009 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [ceph] 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): pool = mypool 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:31:26.644 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): id = nvmeof.nvmeof.a 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [mtls] 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [spdk] 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:31:26.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): transports = tcp 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): [monitor] 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:31:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.a 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:31:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:26] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.34:5499 for group id 2026-02-18T03:31:26.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: pgmap v250: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 4.30k op/s 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: mon.b calling monitor election 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: mon.c calling monitor election 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: mon.a calling monitor election 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: monmap epoch 3 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:26.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: min_mon_release 20 (tentacle) 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: election_strategy: 1 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: fsmap 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: mgrmap e15: x(active, since 6m) 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:26.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='client.46864 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:26.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:26 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: pgmap v250: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 4.30k op/s 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: mon.b calling monitor election 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:31:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 6m) 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:27.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='client.46864 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:26 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:31:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: pgmap v250: 33 pgs: 33 active+clean; 16 GiB data, 21 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 4.30k op/s 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: mon.b calling monitor election 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: mon.c calling monitor election 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: mon.a calling monitor election 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: monmap epoch 3 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: min_mon_release 20 (tentacle) 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: election_strategy: 1 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:31:27.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: fsmap 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: mgrmap e15: x(active, since 6m) 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='client.46864 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:26 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:27.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.a group id=0 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:31:27.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:27] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='client.46876 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:27 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='client.46876 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:31:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:27 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='client.46876 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:31:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:31:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:31:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:27 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:31:28.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:31:28] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:31:28.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:31:28.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:31:28.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:31:28.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: ], , client address: IPv4 10.20.193.177:42200 2026-02-18T03:31:28.917 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:31:29.164 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:31:29.174 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:28 trial034 ceph-mon[21825]: pgmap v251: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 48 MiB/s wr, 4.67k op/s 2026-02-18T03:31:29.174 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2285254588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:29.176 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:31:29.176 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:31:29.176 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:31:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:28 trial155 ceph-mon[24719]: pgmap v251: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 48 MiB/s wr, 4.67k op/s 2026-02-18T03:31:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2285254588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:29.253 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:31:29.253 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:31:29.253 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:31:29.253 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:31:29.253 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 438677, 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:29.254 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:29.255 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:29.256 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.257 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.258 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.259 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:31:29.260 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:29.261 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:31:29.262 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.263 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:31:29.264 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.265 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:29.266 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:31:29.267 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:29.268 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.269 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "num": 45 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:29.270 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:31:29.271 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:31:29.272 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:31:29.272 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:31:29.273 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:31:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:28 trial086 ceph-mon[73228]: pgmap v251: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 48 MiB/s wr, 4.67k op/s 2026-02-18T03:31:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2285254588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: INFO: Setting log level to WARNING 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.280287] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.280336] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.396538] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:31:29.434 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.433103] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:31:29.435 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.433113] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:31:29.435 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.433126] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.433127] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.549714] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:31:29.691 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO discovery.py:369 (81): discovery addr: 10.20.193.34 port: 8009 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.597363] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.597415] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:31:29.692 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial034). 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial034). 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO state.py:2073 (81): Initialization is over (discovery-trial034). 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.693 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.694 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4130999309' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: Cluster is now healthy 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3639689359' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:31:29.965 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1426989126' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:31:29.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.937594] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.34:0/1347731066, rc 0 2026-02-18T03:31:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.937681] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.34:0/1347731066 2026-02-18T03:31:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.34:0/1347731066' 2026-02-18T03:31:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.964098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4130999309' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:31:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:31:30.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: Cluster is now healthy 2026-02-18T03:31:30.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/3639689359' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:31:30.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:29 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1426989126' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:30.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:29] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:31:30.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.972304] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:31:30.246 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.972584] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:29.972608] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.121374] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.34:0/755392254, rc 0 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.121470] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.34:0/755392254 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.34:0/755392254' 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.135307] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.145047] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.145082] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.247 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/4130999309' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: Cluster is now healthy 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3639689359' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:31:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:29 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1426989126' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.285858] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.34:0/3986725623, rc 0 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.288083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.34:0/3986725623 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.34:0/3986725623' 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.306118] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.310613] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.310653] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.451239] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.34:0/918547498, rc 0 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.452083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.34:0/918547498 2026-02-18T03:31:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.34:0/918547498' 2026-02-18T03:31:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.466318] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:31:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.470861] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:31:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.470889] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:30.759 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:31:30.759 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:31:30.759 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:31:30.759 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:31:30.759 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 5060, 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 4, 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:31:30.760 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.761 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.762 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:31:30.763 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:31:30.764 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.765 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:31:30.766 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.767 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.768 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.769 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.770 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.771 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.772 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:31:30.773 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:31:30.775 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:31:30.775 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:31:30.775 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.588967] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.34:0/2851568010, rc 0 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.599087] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.34:0/2851568010 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.34:0/2851568010' 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.616093] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.850 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.623361] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.623403] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.733703] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.34:0/2028135122, rc 0 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.734090] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.34:0/2028135122 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.34:0/2028135122' 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.751097] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.759641] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.759679] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:30.851 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:30.852 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:30.855 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:31:30.855 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 402867, 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.856 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 4, 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.857 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.858 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:31:30.859 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.860 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:31:30.861 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:31:30.862 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:31:30.863 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.864 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.865 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.866 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:31:30.867 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.868 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.869 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:31:30.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "num": 69 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:31:30.871 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:31:30.872 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:31:30.872 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:31:30.873 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:31:30.873 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:31:30.873 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:31:31.139 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-mon[21825]: pgmap v252: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 40 MiB/s wr, 3.98k op/s 2026-02-18T03:31:31.140 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.140 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.140 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.140 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.140 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.892755] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.34:0/4079599664, rc 0 2026-02-18T03:31:31.140 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.893088] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.34:0/4079599664 2026-02-18T03:31:31.140 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.34:0/4079599664' 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.908204] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:30] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.913189] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:30.913219] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.045816] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.34:0/873019522, rc 0 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.045901] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.34:0/873019522 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.34:0/873019522' 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.061104] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.141 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:31:31.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.065955] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:31:31.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.065984] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:31.143 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:31:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:30 trial155 ceph-mon[24719]: pgmap v252: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 40 MiB/s wr, 3.98k op/s 2026-02-18T03:31:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:30 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:30 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:30 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:30 trial155 ceph-mon[24719]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:30 trial086 ceph-mon[73228]: pgmap v252: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 40 MiB/s wr, 3.98k op/s 2026-02-18T03:31:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:30 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:30 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:30 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:31:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:30 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:31:31.428 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.428 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.428 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.210846] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.34:0/461764168, rc 0 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.211083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.34:0/461764168 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.34:0/461764168' 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.230475] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.238620] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.238659] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.387429] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.34:0/3816162738, rc 0 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.388490] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.34:0/3816162738 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.34:0/3816162738' 2026-02-18T03:31:31.429 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.427809] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:31:31.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.433403] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:31:31.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.433437] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.576595] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.34:0/3852506995, rc 0 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.577088] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.34:0/3852506995 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.34:0/3852506995' 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.609265] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.614311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.614341] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:31.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 246.00 2.4M 2.4M 0.0k 23.7M 24.0M 0.0k nvme12n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 258.30 2.6M 2.5M 0.0k 25.9M 24.6M 0.0k nvme16n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 256.00 2.5M 2.6M 0.0k 25.0M 26.5M 0.0k nvme20n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 255.90 2.6M 2.5M 0.0k 25.8M 24.9M 0.0k nvme24n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 256.40 2.5M 2.6M 0.0k 25.3M 25.7M 0.0k nvme28n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 250.40 2.4M 2.6M 0.0k 24.1M 26.0M 0.0k nvme32n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 258.10 2.5M 2.5M 0.0k 24.6M 25.4M 0.0k nvme36n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 256.90 2.7M 2.6M 0.0k 26.7M 25.6M 0.0k nvme40n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 249.90 2.5M 2.4M 0.0k 24.6M 24.3M 0.0k nvme44n3 2026-02-18T03:31:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 262.70 2.5M 2.6M 0.0k 25.2M 25.7M 0.0k nvme48n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 256.40 2.7M 2.5M 0.0k 26.9M 25.4M 0.0k nvme4n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 253.60 2.5M 2.4M 0.0k 24.6M 24.2M 0.0k nvme52n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 252.10 2.5M 2.4M 0.0k 25.5M 24.4M 0.0k nvme56n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 250.50 2.4M 2.6M 0.0k 24.2M 26.3M 0.0k nvme60n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 253.10 2.6M 2.6M 0.0k 26.0M 26.0M 0.0k nvme64n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 251.50 2.5M 2.6M 0.0k 24.8M 25.5M 0.0k nvme8n3 2026-02-18T03:31:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.786574] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.34:0/2675754443, rc 0 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.788109] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.34:0/2675754443 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.34:0/2675754443' 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.822112] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.828523] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:31.828564] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4127718044' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=13,kv=51} crc {auth=965055119,config=3825401348,health=1796179531,kv=2437282544}) 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=714648753}) 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=19,logm=81} crc {kv=1269268441,logm=1438126581}) 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1410996460}) 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3984845772}) 2026-02-18T03:31:31.985 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3996668380}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1823760450}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1206025496}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4247708836}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2818534531}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3591700}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2332954232}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2114202381}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210191208}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2750346676}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135281951}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1718101367}) 2026-02-18T03:31:31.986 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2969620269}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1977172812}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3450782243}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=560736680}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1008931406}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615906482}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=65,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=1009276183,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2724578577}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=1150525850}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=81,mon_config_key=19} crc {mgrstat=2674390836,mon_config_key=1395249998}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1526417691}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=94,monmap=5,nvmeofgw=1} crc {mon_config_key=3227381254,monmap=1407976167,nvmeofgw=708365199}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=4082506531}) 2026-02-18T03:31:31.987 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=916358748,osd_metadata=2727074769,osd_pg_creating=1161151261,osd_snap=3842414688,osdmap=2496737643}) 2026-02-18T03:31:31.988 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=36} crc {osdmap=97019747}) 2026-02-18T03:31:31.988 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1411038701' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:31.988 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2110165837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:32.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/4127718044' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=13,kv=51} crc {auth=965055119,config=3825401348,health=1796179531,kv=2437282544}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=714648753}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {kv=19,logm=81} crc {kv=1269268441,logm=1438126581}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1410996460}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3984845772}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3996668380}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1823760450}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1206025496}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4247708836}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2818534531}) 2026-02-18T03:31:32.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3591700}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2332954232}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2114202381}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210191208}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2750346676}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135281951}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1718101367}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2969620269}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1977172812}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3450782243}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=560736680}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1008931406}) 2026-02-18T03:31:32.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615906482}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {logm=65,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=1009276183,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2724578577}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=1150525850}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=81,mon_config_key=19} crc {mgrstat=2674390836,mon_config_key=1395249998}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1526417691}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=94,monmap=5,nvmeofgw=1} crc {mon_config_key=3227381254,monmap=1407976167,nvmeofgw=708365199}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=4082506531}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=916358748,osd_metadata=2727074769,osd_pg_creating=1161151261,osd_snap=3842414688,osdmap=2496737643}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=36} crc {osdmap=97019747}) 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1411038701' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:32.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2110165837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:32.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.024096] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.34:0/372310809, rc 0 2026-02-18T03:31:32.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.025087] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.34:0/372310809 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.34:0/372310809' 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.043039] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.048519] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.048549] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.175862] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.34:0/3927784799, rc 0 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.176080] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.34:0/3927784799 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.34:0/3927784799' 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.196689] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:32.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:31:32.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.201937] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:31:32.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.201968] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/4127718044' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:31:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=13,kv=51} crc {auth=965055119,config=3825401348,health=1796179531,kv=2437282544}) 2026-02-18T03:31:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=714648753}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {kv=19,logm=81} crc {kv=1269268441,logm=1438126581}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1410996460}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3984845772}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3996668380}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1823760450}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1206025496}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4247708836}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2818534531}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3591700}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2332954232}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2114202381}) 2026-02-18T03:31:32.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210191208}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2750346676}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135281951}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1718101367}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2969620269}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1977172812}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3450782243}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=560736680}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1008931406}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615906482}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=65,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=1009276183,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2724578577}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=1150525850}) 2026-02-18T03:31:32.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=81,mon_config_key=19} crc {mgrstat=2674390836,mon_config_key=1395249998}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1526417691}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=94,monmap=5,nvmeofgw=1} crc {mon_config_key=3227381254,monmap=1407976167,nvmeofgw=708365199}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=4082506531}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=916358748,osd_metadata=2727074769,osd_pg_creating=1161151261,osd_snap=3842414688,osdmap=2496737643}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=36} crc {osdmap=97019747}) 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1411038701' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:32.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:31 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2110165837' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.377832] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.34:0/1590789408, rc 0 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.388086] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.34:0/1590789408 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.34:0/1590789408' 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.412092] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:31:32.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.420326] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.420361] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.589015] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.34:0/3653538165, rc 0 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.591071] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.34:0/3653538165 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.34:0/3653538165' 2026-02-18T03:31:32.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.603478] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:32.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:31:32.908 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.621238] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.621279] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.780708] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.34:0/4109700487, rc 0 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.781073] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.34:0/4109700487 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.34:0/4109700487' 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.808350] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.818786] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:31:32.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.818824] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:33.222 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-mon[21825]: pgmap v253: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 4.32k op/s 2026-02-18T03:31:33.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.983524] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.34:0/328484143, rc 0 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.983603] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.34:0/328484143 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.34:0/328484143' 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:32.999078] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:32] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.006209] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.006250] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.119813] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.34:0/1304663891, rc 0 2026-02-18T03:31:33.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.119890] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.34:0/1304663891 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.34:0/1304663891' 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.133906] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.141010] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.141043] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:32 trial155 ceph-mon[24719]: pgmap v253: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 4.32k op/s 2026-02-18T03:31:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:32 trial086 ceph-mon[73228]: pgmap v253: 33 pgs: 33 active+clean; 16 GiB data, 22 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 4.32k op/s 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.254795] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.34:0/1319209737, rc 0 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.254910] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.34:0/1319209737 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.34:0/1319209737' 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.267788] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.272333] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.272364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.388811] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.34:0/2664393859, rc 0 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.388880] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.34:0/2664393859 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.34:0/2664393859' 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.404265] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.412750] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.412780] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.537570] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.34:0/3795297524, rc 0 2026-02-18T03:31:33.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.537661] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.34:0/3795297524 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.34:0/3795297524' 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.556080] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.567517] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.567557] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.692055] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.34:0/1886180407, rc 0 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.695090] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.34:0/1886180407 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.34:0/1886180407' 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.712892] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.720180] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:31:33.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.720211] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:34.062 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.062 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.062 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.842426] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.34:0/3700533994, rc 0 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.853101] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.34:0/3700533994 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.34:0/3700533994' 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.880100] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:33] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.890434] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:33.890468] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.041440] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.34:0/923077868, rc 0 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.041546] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.34:0/923077868 2026-02-18T03:31:34.063 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.34:0/923077868' 2026-02-18T03:31:34.064 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.061755] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:31:34.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.067433] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:31:34.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.067468] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.210875] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.34:0/1717884831, rc 0 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.211074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.34:0/1717884831 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.34:0/1717884831' 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.233437] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.239026] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.239070] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.378527] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.34:0/1646630079, rc 0 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.379082] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.34:0/1646630079 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.34:0/1646630079' 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.401077] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:31:34.607 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.418366] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:31:34.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.418399] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:34.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.608 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.606659] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.34:0/1408000202, rc 0 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.607085] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.34:0/1408000202 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.34:0/1408000202' 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.640104] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.652322] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.652371] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:34.914 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.809612] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.34:0/954925291, rc 0 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.809751] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.34:0/954925291 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.34:0/954925291' 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.835735] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.840597] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:31:34.915 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.840629] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:35.175 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-mon[21825]: pgmap v254: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 43 MiB/s wr, 4.34k op/s 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.989192] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.34:0/3226627933, rc 0 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:34.989282] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.34:0/3226627933 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.34:0/3226627933' 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.021831] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:35.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.026455] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.026490] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.155335] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.34:0/1441709232, rc 0 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.157593] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.34:0/1441709232 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.34:0/1441709232' 2026-02-18T03:31:35.177 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.175257] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:34 trial155 ceph-mon[24719]: pgmap v254: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 43 MiB/s wr, 4.34k op/s 2026-02-18T03:31:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:34 trial086 ceph-mon[73228]: pgmap v254: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 43 MiB/s wr, 4.34k op/s 2026-02-18T03:31:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:31:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.180214] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:31:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.180253] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.463 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.292254] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.34:0/1105810760, rc 0 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.293076] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.34:0/1105810760 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.34:0/1105810760' 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.307072] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.327333] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.327376] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.464 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.462282] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:35.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:31:35.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.469037] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.469073] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.632862] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.637566] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.637605] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:35.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:31:35] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:31:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:31:35.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:31:35.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: OPTIMIZED 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:54784 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.623556] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000228 seconds 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.639658] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000299 seconds 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.691083] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000308 seconds 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.707040] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000290 seconds 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.722969] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000261 seconds 2026-02-18T03:31:35.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.739037] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000325 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.755074] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000341 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.771043] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000326 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.787098] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000382 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.803112] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000380 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.819011] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000276 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.835020] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000283 seconds 2026-02-18T03:31:35.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [2026-02-18 03:31:35.859039] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000327 seconds 2026-02-18T03:31:36.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3864159450' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.772826] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.798264] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.798313] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.936093] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:35] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:31:36.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.950212] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:31:36.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:35.950263] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3864159450' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.106414] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.116012] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.116059] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:36.351 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.255091] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.262727] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.262771] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.352 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3864159450' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:36.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.387875] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:31:36.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.392366] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:31:36.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.392395] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:36.629 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.526327] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.531155] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.531187] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.630 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.686095] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.693061] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.693105] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:36.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:36.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.860467] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:36.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:36] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:31:36.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.866464] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:31:36.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:36.866502] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:37.173 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:36 trial034 ceph-mon[21825]: pgmap v255: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.09k op/s 2026-02-18T03:31:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.173 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.067408] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.078494] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.078535] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:36 trial155 ceph-mon[24719]: pgmap v255: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.09k op/s 2026-02-18T03:31:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:36 trial086 ceph-mon[73228]: pgmap v255: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.09k op/s 2026-02-18T03:31:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.214387] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.220837] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.220871] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.361085] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.366232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:31:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.366264] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:37.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.512310] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:37.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:31:37.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.516931] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:31:37.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.516967] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.654463] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.662604] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.662637] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:37.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.796337] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.803284] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.803318] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.960083] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:37] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.969096] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:31:38.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:37.969138] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.124783] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.129321] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.129353] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.297468] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.302027] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.302071] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.387 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.430665] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.435329] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.435361] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.672 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.572076] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.578597] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.578635] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.673 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.721866] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.726310] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.726336] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:38.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.892081] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:38.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:38] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:31:38.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.896629] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:31:38.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:38.896661] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:39.220 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-mon[21825]: pgmap v256: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 4.34k op/s 2026-02-18T03:31:39.220 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/979163204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.220 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3481983938' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:39.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.060506] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.074377] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.074414] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:39.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.219093] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:38 trial155 ceph-mon[24719]: pgmap v256: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 4.34k op/s 2026-02-18T03:31:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:38 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/979163204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:38 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3481983938' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:38 trial086 ceph-mon[73228]: pgmap v256: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 4.34k op/s 2026-02-18T03:31:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:38 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/979163204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:38 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3481983938' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:39.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.261376] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.261435] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.397184] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.401633] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.401657] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:39.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.568858] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.576947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.576988] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.726171] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:39.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:31:39.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.732397] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:31:39.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.732429] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:31:40.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:40.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.891353] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:39] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.903508] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:39.903551] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.084057] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.089828] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:31:40.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.089856] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:40.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:40.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.259899] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.266884] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.266918] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:31:40.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.404791] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.409489] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.409520] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.513290] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.34 port 4420 *** 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.705424] ctrlr.c: 852:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc' to connect at this address. 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.705671] ctrlr.c: 852:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode10' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc' to connect at this address. 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.706093] ctrlr.c: 852:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode15' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc' to connect at this address. 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.708005] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:31:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:40.708176] ctrlr.c: 852:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode6' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc' to connect at this address. 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:40.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:41.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-mon[21825]: pgmap v257: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 4.13k op/s 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:31:41.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:40] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:31:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:40 trial155 ceph-mon[24719]: pgmap v257: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 4.13k op/s 2026-02-18T03:31:41.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:40 trial086 ceph-mon[73228]: pgmap v257: 33 pgs: 33 active+clean; 16 GiB data, 23 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 4.13k op/s 2026-02-18T03:31:41.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:41.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 229.70 2.2M 2.2M 0.0k 22.3M 22.2M 0.0k nvme12n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 230.20 2.0M 2.3M 0.0k 20.5M 22.8M 0.0k nvme16n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 233.50 2.2M 2.2M 0.0k 22.2M 22.1M 0.0k nvme20n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 231.20 2.1M 2.2M 0.0k 21.3M 22.5M 0.0k nvme24n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 239.70 2.2M 2.4M 0.0k 22.5M 24.0M 0.0k nvme28n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 243.30 2.5M 2.3M 0.0k 24.8M 22.8M 0.0k nvme32n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 242.10 2.3M 2.3M 0.0k 23.1M 22.5M 0.0k nvme36n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 245.60 2.4M 2.3M 0.0k 23.8M 23.0M 0.0k nvme40n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 236.30 2.3M 2.2M 0.0k 23.3M 22.4M 0.0k nvme44n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 234.50 2.2M 2.3M 0.0k 22.0M 23.4M 0.0k nvme48n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 237.80 2.3M 2.3M 0.0k 22.8M 22.5M 0.0k nvme4n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 227.80 2.2M 2.3M 0.0k 21.8M 23.4M 0.0k nvme52n3 2026-02-18T03:31:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 233.70 2.3M 2.3M 0.0k 22.7M 22.9M 0.0k nvme56n3 2026-02-18T03:31:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 237.10 2.2M 2.3M 0.0k 22.4M 23.3M 0.0k nvme60n3 2026-02-18T03:31:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 236.20 2.3M 2.3M 0.0k 23.2M 23.2M 0.0k nvme64n3 2026-02-18T03:31:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.30 2.1M 2.2M 0.0k 21.0M 21.9M 0.0k nvme8n3 2026-02-18T03:31:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:42.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:41 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1852342496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:42.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1852342496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:42.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:41 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1852342496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:42 trial155 ceph-mon[24719]: pgmap v258: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.59k op/s 2026-02-18T03:31:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2444189393' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:42 trial034 ceph-mon[21825]: pgmap v258: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.59k op/s 2026-02-18T03:31:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2444189393' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-mon[73228]: pgmap v258: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 39 MiB/s wr, 4.59k op/s 2026-02-18T03:31:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2444189393' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:31:42] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:31:43.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:31:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:31:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:31:43.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:54858 2026-02-18T03:31:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:44 trial155 ceph-mon[24719]: pgmap v259: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 4.66k op/s 2026-02-18T03:31:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:44 trial034 ceph-mon[21825]: pgmap v259: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 4.66k op/s 2026-02-18T03:31:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:44 trial086 ceph-mon[73228]: pgmap v259: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 4.66k op/s 2026-02-18T03:31:46.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3401134182' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:46.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2672435077' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3401134182' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2672435077' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:31:45] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:31:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:31:46.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:31:46.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 1 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:31:46.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:36736 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:45.952195] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000227 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:45.968211] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000278 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:45.984183] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000217 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.008244] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000248 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.024201] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000235 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.041067] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.001119 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.056149] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000205 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.072196] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000259 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.096190] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000250 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.112191] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000254 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.128159] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000215 seconds 2026-02-18T03:31:46.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.152261] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000298 seconds 2026-02-18T03:31:46.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.168195] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000260 seconds 2026-02-18T03:31:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:45 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3401134182' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:45 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2672435077' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:46 trial155 ceph-mon[24719]: pgmap v260: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 4.37k op/s 2026-02-18T03:31:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:46 trial034 ceph-mon[21825]: pgmap v260: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 4.37k op/s 2026-02-18T03:31:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:46 trial086 ceph-mon[73228]: pgmap v260: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 4.37k op/s 2026-02-18T03:31:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:48 trial155 ceph-mon[24719]: pgmap v261: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.40k op/s 2026-02-18T03:31:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:48 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1150003465' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:48 trial034 ceph-mon[21825]: pgmap v261: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.40k op/s 2026-02-18T03:31:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1150003465' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:48 trial086 ceph-mon[73228]: pgmap v261: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.40k op/s 2026-02-18T03:31:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:48 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1150003465' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:50.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:49 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/993954630' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/993954630' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:49 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/993954630' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:50 trial155 ceph-mon[24719]: pgmap v262: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.18k op/s 2026-02-18T03:31:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:50 trial034 ceph-mon[21825]: pgmap v262: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.18k op/s 2026-02-18T03:31:51.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:50 trial086 ceph-mon[73228]: pgmap v262: 33 pgs: 33 active+clean; 16 GiB data, 24 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.18k op/s 2026-02-18T03:31:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 222.20 2.0M 2.2M 0.0k 20.0M 21.7M 0.0k nvme12n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 228.20 2.1M 2.0M 0.0k 21.3M 20.4M 0.0k nvme16n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 231.80 2.2M 2.2M 0.0k 21.9M 21.7M 0.0k nvme20n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 237.00 2.3M 2.2M 0.0k 23.0M 22.4M 0.0k nvme24n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 235.90 2.2M 2.1M 0.0k 22.4M 21.1M 0.0k nvme28n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 237.20 2.1M 2.3M 0.0k 21.1M 22.6M 0.0k nvme32n3 2026-02-18T03:31:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 233.90 2.1M 2.2M 0.0k 21.4M 21.8M 0.0k nvme36n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 235.00 2.3M 2.2M 0.0k 23.0M 22.1M 0.0k nvme40n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 239.50 2.4M 2.2M 0.0k 23.6M 21.7M 0.0k nvme44n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 242.30 2.3M 2.1M 0.0k 23.4M 21.4M 0.0k nvme48n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 226.70 2.2M 2.1M 0.0k 21.5M 20.8M 0.0k nvme4n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 234.30 2.3M 2.1M 0.0k 22.6M 21.1M 0.0k nvme52n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 240.80 2.3M 2.2M 0.0k 23.0M 21.7M 0.0k nvme56n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 229.10 2.1M 2.2M 0.0k 21.3M 21.8M 0.0k nvme60n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 228.80 2.2M 2.2M 0.0k 21.5M 21.6M 0.0k nvme64n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 232.10 2.2M 2.2M 0.0k 22.1M 21.5M 0.0k nvme8n3 2026-02-18T03:31:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:31:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:52 trial155 ceph-mon[24719]: pgmap v263: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.11k op/s 2026-02-18T03:31:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:52 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/712323893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:52 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3096356114' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:52 trial034 ceph-mon[21825]: pgmap v263: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.11k op/s 2026-02-18T03:31:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/712323893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3096356114' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:52 trial086 ceph-mon[73228]: pgmap v263: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.11k op/s 2026-02-18T03:31:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:52 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/712323893' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:52 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3096356114' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:54 trial155 ceph-mon[24719]: pgmap v264: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.00k op/s 2026-02-18T03:31:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:54 trial034 ceph-mon[21825]: pgmap v264: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.00k op/s 2026-02-18T03:31:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:54 trial086 ceph-mon[73228]: pgmap v264: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 4.00k op/s 2026-02-18T03:31:56.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:55 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/345110743' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:56.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:55 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/345110743' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:55 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/345110743' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:56 trial155 ceph-mon[24719]: pgmap v265: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.66k op/s 2026-02-18T03:31:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:56 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3219343842' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:56 trial034 ceph-mon[21825]: pgmap v265: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.66k op/s 2026-02-18T03:31:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3219343842' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:56 trial086 ceph-mon[73228]: pgmap v265: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.66k op/s 2026-02-18T03:31:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:56 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3219343842' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:31:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:58 trial155 ceph-mon[24719]: pgmap v266: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.72k op/s 2026-02-18T03:31:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:58 trial034 ceph-mon[21825]: pgmap v266: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.72k op/s 2026-02-18T03:31:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:58 trial086 ceph-mon[73228]: pgmap v266: 33 pgs: 33 active+clean; 16 GiB data, 25 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.72k op/s 2026-02-18T03:32:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:59 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3397865228' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:31:59 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1388498944' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3397865228' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:31:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1388498944' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3397865228' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:31:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1388498944' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:00 trial155 ceph-mon[24719]: pgmap v267: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.65k op/s 2026-02-18T03:32:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:00 trial034 ceph-mon[21825]: pgmap v267: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.65k op/s 2026-02-18T03:32:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:00 trial086 ceph-mon[73228]: pgmap v267: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.65k op/s 2026-02-18T03:32:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 224.30 2.0M 2.1M 0.0k 19.9M 20.7M 0.0k nvme12n3 2026-02-18T03:32:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.90 2.0M 2.0M 0.0k 20.0M 20.4M 0.0k nvme16n3 2026-02-18T03:32:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.00 1.9M 2.1M 0.0k 19.1M 20.7M 0.0k nvme20n3 2026-02-18T03:32:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 225.80 2.1M 2.0M 0.0k 21.1M 20.1M 0.0k nvme24n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 227.70 2.1M 2.0M 0.0k 21.2M 19.9M 0.0k nvme28n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 233.90 2.1M 2.1M 0.0k 21.4M 21.1M 0.0k nvme32n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 227.10 2.1M 2.0M 0.0k 21.0M 20.1M 0.0k nvme36n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 223.90 1.9M 2.0M 0.0k 19.4M 20.5M 0.0k nvme40n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 221.40 2.0M 2.1M 0.0k 19.8M 20.8M 0.0k nvme44n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 230.60 2.2M 2.0M 0.0k 21.7M 19.9M 0.0k nvme48n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 227.20 2.1M 2.1M 0.0k 20.8M 21.4M 0.0k nvme4n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 224.90 2.1M 2.0M 0.0k 20.8M 20.0M 0.0k nvme52n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 222.20 2.0M 2.0M 0.0k 20.3M 20.1M 0.0k nvme56n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 216.30 1.9M 2.1M 0.0k 18.8M 20.7M 0.0k nvme60n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 230.30 2.1M 2.1M 0.0k 20.9M 21.3M 0.0k nvme64n3 2026-02-18T03:32:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 220.00 2.0M 2.1M 0.0k 20.0M 20.6M 0.0k nvme8n3 2026-02-18T03:32:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:02 trial155 ceph-mon[24719]: pgmap v268: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.71k op/s 2026-02-18T03:32:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:02 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/710396516' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:02 trial034 ceph-mon[21825]: pgmap v268: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.71k op/s 2026-02-18T03:32:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/710396516' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:02 trial086 ceph-mon[73228]: pgmap v268: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.71k op/s 2026-02-18T03:32:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:02 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/710396516' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:03 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/598786108' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/598786108' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/598786108' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:05.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:04 trial155 ceph-mon[24719]: pgmap v269: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.75k op/s 2026-02-18T03:32:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:04 trial034 ceph-mon[21825]: pgmap v269: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.75k op/s 2026-02-18T03:32:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:04 trial086 ceph-mon[73228]: pgmap v269: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.75k op/s 2026-02-18T03:32:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:06 trial034 ceph-mon[21825]: pgmap v270: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.48k op/s 2026-02-18T03:32:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3822424833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1731002450' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:06 trial086 ceph-mon[73228]: pgmap v270: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.48k op/s 2026-02-18T03:32:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:06 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3822424833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:06 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1731002450' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:06 trial155 ceph-mon[24719]: pgmap v270: 33 pgs: 33 active+clean; 16 GiB data, 26 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.48k op/s 2026-02-18T03:32:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3822424833' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:06 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1731002450' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:09.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:08 trial034 ceph-mon[21825]: pgmap v271: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 33 MiB/s wr, 3.62k op/s 2026-02-18T03:32:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:08 trial086 ceph-mon[73228]: pgmap v271: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 33 MiB/s wr, 3.62k op/s 2026-02-18T03:32:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:08 trial155 ceph-mon[24719]: pgmap v271: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 33 MiB/s wr, 3.62k op/s 2026-02-18T03:32:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2721292998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2721292998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:09 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2721292998' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:10 trial034 ceph-mon[21825]: pgmap v272: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.61k op/s 2026-02-18T03:32:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2132962237' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:10 trial086 ceph-mon[73228]: pgmap v272: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.61k op/s 2026-02-18T03:32:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:10 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2132962237' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:11.378 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:10 trial155 ceph-mon[24719]: pgmap v272: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.61k op/s 2026-02-18T03:32:11.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:10 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2132962237' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:11.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:11.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 225.00 2.0M 2.0M 0.0k 20.0M 20.1M 0.0k nvme12n3 2026-02-18T03:32:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 235.10 2.1M 2.1M 0.0k 21.2M 20.7M 0.0k nvme16n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 232.80 2.3M 2.3M 0.0k 22.6M 22.8M 0.0k nvme20n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.40 2.0M 2.0M 0.0k 20.3M 19.7M 0.0k nvme24n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 220.80 1.9M 2.0M 0.0k 18.5M 20.2M 0.0k nvme28n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 224.40 2.6M 2.9M 0.0k 26.1M 28.8M 0.0k nvme32n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 231.90 2.3M 2.2M 0.0k 23.3M 22.4M 0.0k nvme36n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 231.20 2.4M 2.3M 0.0k 23.9M 22.6M 0.0k nvme40n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 232.40 2.2M 2.1M 0.0k 21.9M 21.4M 0.0k nvme44n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.10 2.8M 2.7M 0.0k 28.1M 27.0M 0.0k nvme48n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 228.40 2.0M 2.0M 0.0k 20.3M 19.9M 0.0k nvme4n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.00 2.0M 2.0M 0.0k 19.6M 19.6M 0.0k nvme52n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 233.40 2.2M 2.0M 0.0k 21.6M 20.0M 0.0k nvme56n3 2026-02-18T03:32:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.40 2.2M 2.1M 0.0k 21.6M 20.7M 0.0k nvme60n3 2026-02-18T03:32:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 213.30 1.9M 2.0M 0.0k 18.6M 19.8M 0.0k nvme64n3 2026-02-18T03:32:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 230.40 2.6M 2.4M 0.0k 25.8M 23.5M 0.0k nvme8n3 2026-02-18T03:32:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:12 trial034 ceph-mon[21825]: pgmap v273: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.73k op/s 2026-02-18T03:32:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:12 trial086 ceph-mon[73228]: pgmap v273: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.73k op/s 2026-02-18T03:32:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:12 trial155 ceph-mon[24719]: pgmap v273: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.73k op/s 2026-02-18T03:32:14.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1505927920' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:14.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3464987192' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1505927920' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3464987192' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:13 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/1505927920' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:13 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/3464987192' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:15.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:14 trial034 ceph-mon[21825]: pgmap v274: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.79k op/s 2026-02-18T03:32:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:14 trial086 ceph-mon[73228]: pgmap v274: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.79k op/s 2026-02-18T03:32:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:14 trial155 ceph-mon[24719]: pgmap v274: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.79k op/s 2026-02-18T03:32:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:16 trial034 ceph-mon[21825]: pgmap v275: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.54k op/s 2026-02-18T03:32:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/682946622' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:16 trial086 ceph-mon[73228]: pgmap v275: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.54k op/s 2026-02-18T03:32:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/682946622' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:16 trial155 ceph-mon[24719]: pgmap v275: 33 pgs: 33 active+clean; 16 GiB data, 27 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.54k op/s 2026-02-18T03:32:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:16 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/682946622' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:18.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3164343692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:17 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3164343692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:17 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3164343692' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:18 trial034 ceph-mon[21825]: pgmap v276: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.67k op/s 2026-02-18T03:32:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:18 trial086 ceph-mon[73228]: pgmap v276: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.67k op/s 2026-02-18T03:32:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:18 trial155 ceph-mon[24719]: pgmap v276: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.67k op/s 2026-02-18T03:32:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:21 trial034 ceph-mon[21825]: pgmap v277: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:32:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3486230307' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2175051694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:21 trial086 ceph-mon[73228]: pgmap v277: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:32:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:21 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3486230307' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:21 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2175051694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:21 trial155 ceph-mon[24719]: pgmap v277: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:32:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/3486230307' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:21 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/2175051694' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:21.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:21.736 INFO:tasks.workunit.client.0.trial014.stdout: 234.00 3.2M 2.9M 0.0k 32.1M 29.4M 0.0k nvme12n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 218.70 3.5M 3.5M 0.0k 35.0M 35.0M 0.0k nvme16n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 218.10 3.6M 3.4M 0.0k 36.1M 34.3M 0.0k nvme20n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 222.70 3.3M 3.4M 0.0k 32.7M 34.1M 0.0k nvme24n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.60 3.5M 3.4M 0.0k 34.6M 33.8M 0.0k nvme28n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.70 3.3M 3.5M 0.0k 33.3M 35.3M 0.0k nvme32n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 225.20 3.8M 3.4M 0.0k 37.7M 33.6M 0.0k nvme36n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 217.40 3.5M 3.5M 0.0k 35.4M 34.6M 0.0k nvme40n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 217.00 3.6M 3.5M 0.0k 36.4M 34.8M 0.0k nvme44n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 223.60 3.7M 3.3M 0.0k 36.9M 33.2M 0.0k nvme48n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 215.10 3.3M 3.4M 0.0k 32.7M 33.7M 0.0k nvme4n3 2026-02-18T03:32:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 219.30 3.0M 3.0M 0.0k 30.0M 30.2M 0.0k nvme52n3 2026-02-18T03:32:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 3.3M 3.3M 0.0k 32.6M 32.7M 0.0k nvme56n3 2026-02-18T03:32:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 214.80 3.4M 3.5M 0.0k 34.4M 35.3M 0.0k nvme60n3 2026-02-18T03:32:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.20 2.9M 3.2M 0.0k 28.5M 31.9M 0.0k nvme64n3 2026-02-18T03:32:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 218.70 3.6M 3.4M 0.0k 35.8M 34.3M 0.0k nvme8n3 2026-02-18T03:32:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:23 trial034 ceph-mon[21825]: pgmap v278: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.65k op/s 2026-02-18T03:32:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:23 trial086 ceph-mon[73228]: pgmap v278: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.65k op/s 2026-02-18T03:32:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:23 trial155 ceph-mon[24719]: pgmap v278: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.65k op/s 2026-02-18T03:32:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1210841394' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:24 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1210841394' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:24 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/1210841394' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:25 trial034 ceph-mon[21825]: pgmap v279: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 3.64k op/s 2026-02-18T03:32:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2548866794' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:25 trial086 ceph-mon[73228]: pgmap v279: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 3.64k op/s 2026-02-18T03:32:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2548866794' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:25 trial155 ceph-mon[24719]: pgmap v279: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 52 MiB/s wr, 3.64k op/s 2026-02-18T03:32:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:25 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2548866794' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:27 trial034 ceph-mon[21825]: pgmap v280: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.38k op/s 2026-02-18T03:32:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:27 trial086 ceph-mon[73228]: pgmap v280: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.38k op/s 2026-02-18T03:32:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:27 trial155 ceph-mon[24719]: pgmap v280: 33 pgs: 33 active+clean; 16 GiB data, 28 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.38k op/s 2026-02-18T03:32:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/190397681' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4117072925' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:32:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:28 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/190397681' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/4117072925' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:32:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:28 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/190397681' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/4117072925' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:32:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:32:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:28 trial155 ceph-mon[24719]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:32:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:29 trial034 ceph-mon[21825]: pgmap v281: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.50k op/s 2026-02-18T03:32:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:29 trial086 ceph-mon[73228]: pgmap v281: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.50k op/s 2026-02-18T03:32:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:29 trial155 ceph-mon[24719]: pgmap v281: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.50k op/s 2026-02-18T03:32:31.144 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:32:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:31 trial034 ceph-mon[21825]: pgmap v282: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.43k op/s 2026-02-18T03:32:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/253881672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:31 trial086 ceph-mon[73228]: pgmap v282: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.43k op/s 2026-02-18T03:32:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:31 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/253881672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:31 trial155 ceph-mon[24719]: pgmap v282: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 54 MiB/s wr, 3.43k op/s 2026-02-18T03:32:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:31 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/253881672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:31.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:31.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 213.80 3.3M 3.4M 0.0k 33.0M 33.9M 0.0k nvme12n3 2026-02-18T03:32:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 220.40 3.6M 3.2M 0.0k 35.9M 32.5M 0.0k nvme16n3 2026-02-18T03:32:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.60 3.4M 3.3M 0.0k 34.1M 32.9M 0.0k nvme20n3 2026-02-18T03:32:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 215.60 3.3M 3.2M 0.0k 33.4M 32.0M 0.0k nvme24n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.60 3.4M 3.3M 0.0k 33.8M 32.8M 0.0k nvme28n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.80 3.1M 3.4M 0.0k 30.7M 33.9M 0.0k nvme32n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.00 3.2M 3.4M 0.0k 31.9M 34.0M 0.0k nvme36n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.80 3.1M 3.3M 0.0k 31.4M 32.6M 0.0k nvme40n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.50 3.1M 3.4M 0.0k 31.0M 33.9M 0.0k nvme44n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 216.00 3.3M 3.3M 0.0k 33.2M 33.0M 0.0k nvme48n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.30 3.2M 3.5M 0.0k 32.4M 34.7M 0.0k nvme4n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 3.3M 3.4M 0.0k 32.6M 34.1M 0.0k nvme52n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 3.2M 3.3M 0.0k 31.9M 33.1M 0.0k nvme56n3 2026-02-18T03:32:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 3.3M 3.2M 0.0k 32.6M 31.9M 0.0k nvme60n3 2026-02-18T03:32:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 210.70 3.3M 3.3M 0.0k 33.2M 32.6M 0.0k nvme64n3 2026-02-18T03:32:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.90 3.2M 3.3M 0.0k 32.3M 33.3M 0.0k nvme8n3 2026-02-18T03:32:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:32.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/852747583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:32 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/852747583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:32 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/852747583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:33 trial086 ceph-mon[73228]: pgmap v283: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 3.50k op/s 2026-02-18T03:32:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:33 trial155 ceph-mon[24719]: pgmap v283: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 3.50k op/s 2026-02-18T03:32:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:33 trial034 ceph-mon[21825]: pgmap v283: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 55 MiB/s wr, 3.50k op/s 2026-02-18T03:32:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:35 trial086 ceph-mon[73228]: pgmap v284: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 3.52k op/s 2026-02-18T03:32:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/996530960' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/880404189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:35 trial155 ceph-mon[24719]: pgmap v284: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 3.52k op/s 2026-02-18T03:32:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/996530960' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:35 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/880404189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:35 trial034 ceph-mon[21825]: pgmap v284: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 55 MiB/s wr, 3.52k op/s 2026-02-18T03:32:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/996530960' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/880404189' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:37 trial086 ceph-mon[73228]: pgmap v285: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 3.31k op/s 2026-02-18T03:32:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:37 trial155 ceph-mon[24719]: pgmap v285: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 3.31k op/s 2026-02-18T03:32:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:37 trial034 ceph-mon[21825]: pgmap v285: 33 pgs: 33 active+clean; 16 GiB data, 29 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 51 MiB/s wr, 3.31k op/s 2026-02-18T03:32:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:38 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2641274305' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:38 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/2641274305' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2641274305' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:39 trial086 ceph-mon[73228]: pgmap v286: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:32:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:39 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2032148780' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:39.421 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:39 trial034 ceph-mon[21825]: pgmap v286: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:32:39.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2032148780' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:39 trial155 ceph-mon[24719]: pgmap v286: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:32:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:39 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2032148780' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:41 trial086 ceph-mon[73228]: pgmap v287: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 3.37k op/s 2026-02-18T03:32:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:41 trial155 ceph-mon[24719]: pgmap v287: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 3.37k op/s 2026-02-18T03:32:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:41 trial034 ceph-mon[21825]: pgmap v287: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 52 MiB/s wr, 3.37k op/s 2026-02-18T03:32:41.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 3.1M 3.2M 0.0k 30.5M 32.0M 0.0k nvme12n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 216.00 3.2M 3.3M 0.0k 32.2M 33.0M 0.0k nvme16n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 213.90 3.2M 3.3M 0.0k 31.6M 32.8M 0.0k nvme20n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.50 3.0M 3.2M 0.0k 30.1M 32.0M 0.0k nvme24n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 219.30 3.5M 3.2M 0.0k 34.9M 31.5M 0.0k nvme28n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 215.70 3.1M 3.2M 0.0k 30.6M 32.3M 0.0k nvme32n3 2026-02-18T03:32:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 3.0M 3.2M 0.0k 30.4M 32.1M 0.0k nvme36n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.60 3.2M 3.2M 0.0k 31.6M 31.8M 0.0k nvme40n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 215.20 3.2M 3.2M 0.0k 31.7M 32.1M 0.0k nvme44n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 213.20 3.1M 3.2M 0.0k 31.4M 31.7M 0.0k nvme48n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.20 3.1M 3.2M 0.0k 30.9M 32.3M 0.0k nvme4n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 216.10 3.4M 3.3M 0.0k 34.3M 32.9M 0.0k nvme52n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 212.50 3.3M 3.3M 0.0k 33.1M 32.6M 0.0k nvme56n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 215.20 3.4M 3.2M 0.0k 33.8M 31.8M 0.0k nvme60n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.60 3.2M 3.2M 0.0k 31.8M 31.7M 0.0k nvme64n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.90 3.1M 3.2M 0.0k 30.9M 32.2M 0.0k nvme8n3 2026-02-18T03:32:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:42.271 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:32:42.272 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:32:42.272 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:32:42.292 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4214992628' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.292 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1713377695' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.301 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:32:42.301 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:32:42.301 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:31:26 UTC; 1min 16s ago 2026-02-18T03:32:42.301 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80884 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.301 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80885 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 80963 (conmon) 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 320.4M (peak: 323.4M) 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 4min 54.216s 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80965 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80967 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80985 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─81480 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:32:42.302 INFO:teuthology.orchestra.run.trial034.stdout: │ └─81534 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.303 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:32:42.303 INFO:teuthology.orchestra.run.trial034.stdout: └─80963 /usr/bin/conmon --api-version 1 -c fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -u fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata -p /run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:32:42.303 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:32:42.304 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.008244] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000248 seconds 2026-02-18T03:32:42.304 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.024201] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000235 seconds 2026-02-18T03:32:42.304 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.041067] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.001119 seconds 2026-02-18T03:32:42.304 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.056149] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000205 seconds 2026-02-18T03:32:42.304 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.072196] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000259 seconds 2026-02-18T03:32:42.305 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.096190] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000250 seconds 2026-02-18T03:32:42.305 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.112191] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000254 seconds 2026-02-18T03:32:42.305 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.128159] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000215 seconds 2026-02-18T03:32:42.305 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.152261] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000298 seconds 2026-02-18T03:32:42.305 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:31:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:31:46.168195] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000260 seconds 2026-02-18T03:32:42.305 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:32:42.328 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4214992628' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.328 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1713377695' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.337 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:32:42.337 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:32:42.337 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:30:05 UTC; 2min 37s ago 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62368 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62369 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 62448 (conmon) 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 338.9M (peak: 340.5M) 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 10min 20.942s 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62450 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62452 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.338 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62545 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─62983 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout: │ └─62988 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout: └─62448 /usr/bin/conmon --api-version 1 -c 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 -u 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata -p /run/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:32:42.339 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:32:42.340 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: states { 2026-02-18T03:32:42.340 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: grp_id: 1 2026-02-18T03:32:42.340 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: state: INACCESSIBLE 2026-02-18T03:32:42.340 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: } 2026-02-18T03:32:42.340 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:31:42 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: ], , client address: IPv4 10.20.193.86:54858 2026-02-18T03:32:42.341 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:32:42.367 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.155:0/4214992628' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.367 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:42 trial155 ceph-mon[24719]: from='client.? 10.20.193.86:0/1713377695' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:30:09 UTC; 2min 33s ago 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64083 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64084 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 64163 (conmon) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 329.1M (peak: 331.1M) 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 10min 1.356s 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64165 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64167 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64259 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─64624 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: │ └─64629 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: └─64163 /usr/bin/conmon --api-version 1 -c 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb -u 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata -p /run/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.681696] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000348 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.697685] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000304 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.713868] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000509 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.744883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000275 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.760463] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000275 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.776505] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000317 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.792557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000333 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.808539] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000306 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.832548] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000294 seconds 2026-02-18T03:32:42.374 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:30:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:30:26.872558] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000301 seconds 2026-02-18T03:32:42.376 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:26:45 UTC; 5min ago 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Process: 25391 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Process: 25392 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 25702 (conmon) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 1.4G (peak: 1.5G) 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 23min 22.358s 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25704 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25706 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─25727 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─26138 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: │ └─26143 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: └─25702 /usr/bin/conmon --api-version 1 -c 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 -u 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata -p /run/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: states { 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: grp_id: 1 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: state: INACCESSIBLE 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: } 2026-02-18T03:32:42.403 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:31:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: ], , client address: IPv4 10.20.193.177:42200 2026-02-18T03:32:42.404 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:32:42.721 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:32:42.722 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 75s ago 7m trial034=x;count:1 2026-02-18T03:32:42.722 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 75s ago 7m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:32:42.722 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 5m ago 6m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:32:42.722 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 75s ago 6m trial155 2026-02-18T03:32:42.734 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:32:42.916 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:32:42.916 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (76s) 75s ago 5m 54.8M - 1.6.5 99a57256b38c fcedd7379c32 2026-02-18T03:32:42.916 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (2m) 75s ago 2m 330M - 1.6.5 99a57256b38c 4cd4a5649af8 2026-02-18T03:32:42.916 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (2m) 75s ago 2m 331M - 1.6.5 99a57256b38c 7f7bbf3f011b 2026-02-18T03:32:42.917 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (5m) 5m ago 5m 57.7M - 1.6.5 99a57256b38c 14e1b8d88b2e 2026-02-18T03:32:42.925 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:32:43.147 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:32:43.155 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:32:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:43 trial086 ceph-mon[73228]: pgmap v288: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.48k op/s 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 77s) [leader: a] 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 8m) 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 6m), 8 in (since 6m) 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:32:43.381 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: usage: 30 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: client: 50 MiB/s rd, 53 MiB/s wr, 1.73k op/s rd, 1.75k op/s wr 2026-02-18T03:32:43.382 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:32:43.390 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:32:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:43 trial155 ceph-mon[24719]: pgmap v288: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.48k op/s 2026-02-18T03:32:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:43 trial034 ceph-mon[21825]: pgmap v288: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.48k op/s 2026-02-18T03:32:43.629 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:32:43.629 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 125, 2026-02-18T03:32:43.629 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 1, 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 41, 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:32:43.630 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:32:43.631 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:32:43.632 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:32:43.633 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:32:43.638 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:32:43.697 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:32:43.697 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:32:43.697 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.698 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:32:43.704 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:32:43.750 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.751 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:32:43.796 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.797 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:32:43.842 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.843 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:32:43.887 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.889 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:32:43.934 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.935 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:32:43.979 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:43.980 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:32:44.025 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.025 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:32:44.069 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.071 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:32:44.115 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.116 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:32:44.160 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.162 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:32:44.206 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.207 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:32:44.252 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.253 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:32:44.297 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.298 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:32:44.344 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.345 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:32:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:44 trial086 ceph-mon[73228]: from='client.49399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:44 trial086 ceph-mon[73228]: from='client.41946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3692993301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:32:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3670730285' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:32:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2085885444' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:32:44.389 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.390 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:32:44.434 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.435 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:32:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:44 trial155 ceph-mon[24719]: from='client.49399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:44 trial155 ceph-mon[24719]: from='client.41946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:44 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3692993301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:32:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:44 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/3670730285' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:32:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:44 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2085885444' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:32:44.480 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.481 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:32:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:44 trial034 ceph-mon[21825]: from='client.49399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:44 trial034 ceph-mon[21825]: from='client.41946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:32:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3692993301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:32:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3670730285' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:32:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2085885444' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:32:44.524 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.526 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:32:44.611 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.612 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:32:44.700 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.701 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:32:44.774 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.774 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:32:44.870 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.872 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:32:44.916 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:44.917 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:32:45.002 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.003 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:32:45.048 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.049 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:32:45.094 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.095 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:32:45.139 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.141 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:32:45.186 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.187 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:32:45.232 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.233 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:32:45.278 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.279 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:32:45.324 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.325 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:32:45.370 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.371 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:32:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:45 trial086 ceph-mon[73228]: pgmap v289: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.52k op/s 2026-02-18T03:32:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:45 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/875538838' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:45.416 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.417 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:32:45.462 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.463 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:32:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:45 trial155 ceph-mon[24719]: pgmap v289: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.52k op/s 2026-02-18T03:32:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:45 trial155 ceph-mon[24719]: from='client.? 10.20.193.34:0/875538838' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:45.507 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.508 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:32:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:45 trial034 ceph-mon[21825]: pgmap v289: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 53 MiB/s wr, 3.52k op/s 2026-02-18T03:32:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/875538838' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:45.553 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.554 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:32:45.599 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.600 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:32:45.646 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.647 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:32:45.691 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.692 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:32:45.737 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.738 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:32:45.784 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.784 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:32:45.829 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.830 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:32:45.916 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.917 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:32:45.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:45.963 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:32:46.008 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.009 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:32:46.055 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.055 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:32:46.099 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.101 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:32:46.145 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.147 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:32:46.191 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.192 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:32:46.236 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.237 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:32:46.283 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.284 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:32:46.328 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.329 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:32:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:46 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2527222368' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:46.375 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.376 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:32:46.420 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.421 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:32:46.466 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.467 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:32:46.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:46 trial155 ceph-mon[24719]: from='client.? 10.20.193.177:0/2527222368' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:46.513 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.514 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:32:46.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2527222368' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:32:46.558 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.560 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:32:46.604 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.605 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:32:46.649 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.650 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:32:46.695 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.696 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:32:46.741 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.742 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:32:46.786 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.788 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:32:46.834 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.834 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:32:46.878 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:32:46.879 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:32:46.880 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:32:46.880 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:32:46.880 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.b 2026-02-18T03:32:46.880 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon stop nvmeof.nvmeof.b 2026-02-18T03:32:46.881 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:32:46.881 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:32:46.881 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:32:47.176 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to stop nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:32:47.187 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.c 2026-02-18T03:32:47.187 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon stop nvmeof.nvmeof.c 2026-02-18T03:32:47.242 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":81,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:32:47.254 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:32:47 trial034 ceph-mon[21825]: pgmap v290: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:32:47.256 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:32:47.256 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:32:47.256 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:32:47.256 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:32:47.334 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:32:47.334 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 516759, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:32:47.335 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.336 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.337 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:32:47.338 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.339 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:32:47.340 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:32:47.341 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.342 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.343 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.344 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.345 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.346 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:32:47.347 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.348 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.349 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:32:47.350 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "num": 78 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.351 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.352 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:32:47.352 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:32:47.353 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:32:47.353 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:32:47.353 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:32:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:32:47 trial086 ceph-mon[73228]: pgmap v290: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:32:47.422 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to stop nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 81735, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.432 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.433 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.434 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:32:47.435 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.436 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:32:47.437 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:32:47.438 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:32:47.439 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.440 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.441 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.442 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.443 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:32:47.444 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:32:47.446 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.d 2026-02-18T03:32:47.447 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon rm nvmeof.nvmeof.d 2026-02-18T03:32:47.447 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:32:47.447 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:32:47.448 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:32:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 ceph-mon[24719]: pgmap v290: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:32:47.525 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:32:47.525 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:32:47.525 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 20, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 479537, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.526 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.527 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.528 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.529 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.530 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:32:47.531 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:32:47.532 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:32:47.533 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.534 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:32:47.535 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.536 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.537 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.538 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.539 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.540 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "num": 68 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:32:47.541 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:32:47.543 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:32:47.543 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['c'] 2026-02-18T03:32:47.543 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:32:47.543 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.c 2026-02-18T03:32:47.543 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.c 2026-02-18T03:32:47.544 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:32:47.544 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:32:47.826 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 systemd[1]: Stopping Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:32:47.826 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[24715]: 2026-02-18T03:32:47.660+0000 7fede4907640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:32:47.826 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[24715]: 2026-02-18T03:32:47.660+0000 7fede4907640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:32:47.826 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 podman[75433]: 2026-02-18 03:32:47.782783224 +0000 UTC m=+0.137673761 container died 88741c5c788fcfa6eafaf5d46bdd6e8e0f36907577d4d87ba6ef2e3badeb0312 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:32:47.826 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 podman[75433]: 2026-02-18 03:32:47.79873142 +0000 UTC m=+0.153621937 container remove 88741c5c788fcfa6eafaf5d46bdd6e8e0f36907577d4d87ba6ef2e3badeb0312 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:32:47.827 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:32:47 trial155 bash[75433]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c 2026-02-18T03:32:47.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:47 trial086 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:32:47.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:47] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:32:47.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:47] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:32:47.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:47] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.86:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.86:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:32:47.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:47 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:47] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:32:47.910 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service' 2026-02-18T03:32:47.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:32:47.948 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:32:47.948 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:32:47.948 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:32:48.178 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":82,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:32:48.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:47 trial177 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:32:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:47] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:32:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:47] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:32:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:47] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.177:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.177:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:32:48.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:47] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 124 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:32:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:48 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:48] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.b is going down 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:32:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:32:49.536 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 129 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO state.py:1126 (129): Cleanup OMAP on exit (discovery-trial177) 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[25702]: [18-Feb-2026 03:32:49] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:32:49.537 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 podman[38388]: 2026-02-18 03:32:49.395959935 +0000 UTC m=+1.561913051 container died 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, release=, distribution-scope=public, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.version=1.6.5, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., architecture=x86_64, com.redhat.component=ubi9-container, vcs-type=git, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, version=1.6.5, io.ceph.nvmeof=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, io.openshift.wants=ceph,rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.makeflags=, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:32:49.538 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 podman[38388]: 2026-02-18 03:32:49.409008968 +0000 UTC m=+1.574962084 container remove 14e1b8d88b2e199fd85dcfe507279ab3d59cfd52bdefc3bfd374e7b5db2cfcb7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.version=1.6.5, io.spdk.version=25.09, maintainer=Ceph Developers , release=, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.nvmeof=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., architecture=x86_64, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.branch=devel, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, name=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.component=ubi9-container, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.pkgdep-args=--rbd, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.component=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC) 2026-02-18T03:32:49.538 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 bash[38388]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:32:49.538 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:32:49.538 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:32:49.538 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:32:49 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 23min 49.512s CPU time, 1.5G memory peak. 2026-02-18T03:32:49.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial086) 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 podman[74455]: 2026-02-18 03:32:49.350987504 +0000 UTC m=+1.866545940 container died 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.component=ceph-nvmeof, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, org.centos.version=9.0-30.el9, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, version=1.6.5, distribution-scope=public, url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.spdk.version=25.09, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , vcs-type=git, com.redhat.component=ubi9-container, name=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=) 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 podman[74455]: 2026-02-18 03:32:49.364441301 +0000 UTC m=+1.879999737 container remove 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.version=9.0-30.el9, io.ceph.version=1.6.5, io.spdk.build.makeflags=, io.spdk.version=25.09, io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vendor=Red Hat, Inc., io.ceph.nvmeof=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, version=1.6.5, io.ceph.maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, build-date=2026-02-11 09:53:49 UTC) 2026-02-18T03:32:49.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 bash[74455]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:32:49.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:32:49.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:32:49.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 10min 46.963s CPU time, 340.5M memory peak. 2026-02-18T03:32:51.189 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:32:51.423 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":85,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:32:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:51.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:32:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 131.90 2.0M 1.9M 0.0k 20.3M 19.3M 0.0k nvme12n3 2026-02-18T03:32:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 127.10 1.9M 1.8M 0.0k 19.0M 18.5M 0.0k nvme16n3 2026-02-18T03:32:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 126.60 1.8M 1.9M 0.0k 18.3M 19.5M 0.0k nvme20n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 130.60 1.9M 2.0M 0.0k 19.0M 19.8M 0.0k nvme24n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 135.00 2.0M 1.9M 0.0k 19.9M 18.6M 0.0k nvme28n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 132.10 1.9M 1.9M 0.0k 19.2M 19.0M 0.0k nvme32n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 136.80 1.9M 1.9M 0.0k 19.5M 18.6M 0.0k nvme36n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 129.80 1.9M 1.9M 0.0k 18.6M 19.0M 0.0k nvme40n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 130.00 1.9M 1.9M 0.0k 19.4M 19.2M 0.0k nvme44n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 133.70 1.9M 1.8M 0.0k 19.1M 18.0M 0.0k nvme48n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 128.70 1.9M 1.9M 0.0k 18.9M 19.1M 0.0k nvme4n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 125.10 1.8M 1.9M 0.0k 17.5M 18.7M 0.0k nvme52n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 130.40 1.9M 1.9M 0.0k 18.7M 19.3M 0.0k nvme56n3 2026-02-18T03:32:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 126.80 1.9M 1.7M 0.0k 19.4M 17.3M 0.0k nvme60n3 2026-02-18T03:32:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 129.50 1.9M 1.9M 0.0k 18.7M 18.9M 0.0k nvme64n3 2026-02-18T03:32:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 127.60 1.8M 1.8M 0.0k 18.0M 18.0M 0.0k nvme8n3 2026-02-18T03:32:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:32:54.432 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:32:54.661 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":88,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:32:57.671 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:33:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme12n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme16n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme20n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme24n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme28n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme32n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme36n3 2026-02-18T03:33:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme40n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme44n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme48n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme4n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme52n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme56n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme60n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme64n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2026-02-18T03:33:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.446457] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.446633] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.454562] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.454658] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.455200] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.455271] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.455716] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.455762] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.456118] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.456142] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.456554] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.456614] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457046] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457068] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457497] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457515] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457868] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.457885] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.458295] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.458337] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.458686] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.458704] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.459070] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.459096] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.459507] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.459571] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460044] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460068] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460445] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460462] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460784] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.460802] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461170] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461191] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461561] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461585] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461959] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.461978] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.462311] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.462338] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.462701] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.462721] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463086] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463105] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463455] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463480] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463868] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.463885] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464250] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464270] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464592] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464608] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464933] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.464960] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465298] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465321] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465651] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465675] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465971] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.465999] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.466382] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.466403] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.466800] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.466817] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.467165] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.467189] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.467631] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.467657] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.468500] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.468525] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.468776] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.468791] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469204] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469230] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469604] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469624] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469901] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.469924] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.470718] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.470742] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471076] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471099] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471412] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471433] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471964] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.471988] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472276] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472293] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472547] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472561] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472905] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.472930] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473201] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473215] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473500] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473514] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473831] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.473845] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474134] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474148] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474434] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474446] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474787] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.474808] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475193] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475208] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475506] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475520] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475804] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.475818] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.476562] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.476592] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.476930] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.476953] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477286] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477301] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477565] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477585] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477954] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.477973] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.478315] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.478331] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.478610] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.478634] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.478982] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.479033] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.479327] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [2026-02-18 03:33:02.479342] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:33:02.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:33:02.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.155:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.155:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:33:02.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='client.56603 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: Schedule stop daemon nvmeof.nvmeof.b 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:02.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/238186919' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='client.49453 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: Schedule stop daemon nvmeof.nvmeof.c 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: from='client.42018 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.d"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: Remove daemons nvmeof.nvmeof.d 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: Removing daemon nvmeof.nvmeof.d from trial177 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:33:02.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:02 trial034 ceph-mon[21825]: pgmap v291: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.45k op/s 2026-02-18T03:33:02.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: purged_snaps scrub ok 2026-02-18T03:33:02.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: purged_snaps scrub ok 2026-02-18T03:33:02.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: purged_snaps scrub ok 2026-02-18T03:33:02.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: purged_snaps scrub ok 2026-02-18T03:33:02.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='client.56603 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: Schedule stop daemon nvmeof.nvmeof.b 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/238186919' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='client.49453 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: Schedule stop daemon nvmeof.nvmeof.c 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: from='client.42018 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.d"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: Remove daemons nvmeof.nvmeof.d 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: Removing daemon nvmeof.nvmeof.d from trial177 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:33:02.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:02 trial086 ceph-mon[73228]: pgmap v291: 33 pgs: 33 active+clean; 16 GiB data, 30 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.45k op/s 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial155) 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:33:03.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 podman[75690]: 2026-02-18 03:33:02.908419271 +0000 UTC m=+0.266579208 container died 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.version=25.09, io.openshift.wants=ceph,rbd, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-type=git, io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.branch=devel, io.spdk.build.makeflags=, io.ceph.version=1.6.5, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, org.centos.version=9.0-30.el9, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, version=1.6.5, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git) 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 podman[75690]: 2026-02-18 03:33:02.919980775 +0000 UTC m=+0.278140711 container remove 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, name=ceph-nvmeof, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, vendor=Red Hat, Inc., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=undefined, maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.buildah.version=1.29.0, io.spdk.build.makeflags=, io.spdk.version=25.09, io.ceph.git.branch=devel, release=, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.component=ceph-nvmeof, io.openshift.wants=ceph,rbd, distribution-scope=public, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64) 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 bash[75690]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:33:03.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 11min 22.985s CPU time, 331.1M memory peak. 2026-02-18T03:33:03.433 INFO:teuthology.orchestra.run.trial177.stdout:Removed nvmeof.nvmeof.d from host 'trial177' 2026-02-18T03:33:03.447 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 61 secs before reviving 2026-02-18T03:33:03.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1363643580' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1508461730' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: Removing key for client.nvmeof.nvmeof.d 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v292: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.38k op/s 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2285339738' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/991064427' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v293: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.16k op/s 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v294: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 2.60k op/s 2026-02-18T03:33:03.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/767438665' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/976025779' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: Health check failed: 3 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v295: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 26 MiB/s wr, 1.94k op/s 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: mon.b calling monitor election 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: mon.a calling monitor election 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v296: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 20 MiB/s wr, 1.49k op/s 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v297: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 902 op/s 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: pgmap v298: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 394 op/s 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:33:03.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: monmap epoch 3 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: min_mon_release 20 (tentacle) 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: election_strategy: 1 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: fsmap 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: mgrmap e15: x(active, since 8m) 2026-02-18T03:33:03.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"}]': finished 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: osdmap e53: 8 total, 8 up, 8 in 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: nvmeof.nvmeof.d removed from nvmeof gateways dashboard config 2026-02-18T03:33:03.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2644289788' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:03 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1363643580' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1508461730' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.d 2026-02-18T03:33:03.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v292: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.38k op/s 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2285339738' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/991064427' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v293: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.16k op/s 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v294: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 2.60k op/s 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/767438665' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/976025779' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: Health check failed: 3 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v295: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 26 MiB/s wr, 1.94k op/s 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: mon.b calling monitor election 2026-02-18T03:33:03.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v296: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 20 MiB/s wr, 1.49k op/s 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v297: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 902 op/s 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: pgmap v298: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 394 op/s 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:33:03.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: osdmap e52: 8 total, 8 up, 8 in 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 8m) 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"}]': finished 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: osdmap e53: 8 total, 8 up, 8 in 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: nvmeof.nvmeof.d removed from nvmeof gateways dashboard config 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2644289788' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:03.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:03 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:03.902 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":24,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:33:03.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:33:03.912 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:33:03.912 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:33:03.985 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:33:03.985 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:33:03.985 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:33:03.985 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 24, 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 533409, 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:33:03.986 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:03.987 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:03.988 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.989 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.990 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.991 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:33:03.992 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:03.993 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:33:03.994 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.995 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:03.996 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.997 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:03.998 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:33:03.999 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:33:04.000 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.001 INFO:teuthology.orchestra.run.trial034.stdout: "num": 42 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:33:04.002 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:33:04.004 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:33:04.004 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:33:04.004 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 24, 2026-02-18T03:33:04.080 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 98381, 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:04.081 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.082 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:04.083 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:33:04.084 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:33:04.085 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:33:04.086 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.087 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.088 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:04.089 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.090 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:33:04.091 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.092 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.093 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:33:04.094 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:33:04.096 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:33:04.096 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:33:04.256 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:03 trial177 systemd[1]: Starting Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:33:04.256 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 podman[38787]: 2026-02-18 03:33:04.056282716 +0000 UTC m=+0.017775229 container create dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.spdk.git.branch=undefined, io.spdk.version=25.09, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.branch=devel, version=1.6.5, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., architecture=x86_64, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, com.redhat.component=ubi9-container, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, url=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, release=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, name=ceph-nvmeof, maintainer=Ceph Developers , org.centos.version=9.0-30.el9, io.spdk.build.makeflags=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.nvmeof=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, distribution-scope=public) 2026-02-18T03:33:04.257 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 podman[38787]: 2026-02-18 03:33:04.08023788 +0000 UTC m=+0.041730392 container init dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=25.09, io.openshift.wants=ceph,rbd, com.redhat.component=ubi9-container, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, architecture=x86_64, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, vendor=Red Hat, Inc., io.spdk.git.branch=undefined, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, io.spdk.build.makeflags=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.component=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, release=) 2026-02-18T03:33:04.257 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 podman[38787]: 2026-02-18 03:33:04.082335939 +0000 UTC m=+0.043828441 container start dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, vendor=Red Hat, Inc., io.ceph.nvmeof=, name=ceph-nvmeof, maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.maintainer=Ceph Developers , architecture=x86_64, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, release=, io.spdk.version=25.09, io.ceph.git.branch=devel, version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, distribution-scope=public, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.ceph.version=1.6.5, build-date=2026-02-11 09:53:49 UTC, io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.wants=ceph,rbd) 2026-02-18T03:33:04.257 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 bash[38787]: dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa 2026-02-18T03:33:04.257 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 podman[38787]: 2026-02-18 03:33:04.048260647 +0000 UTC m=+0.009753159 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:33:04.257 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 systemd[1]: Started Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:33:04.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:33:04.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:33:04.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:33:04.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:33:04.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [gateway] 2026-02-18T03:33:04.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:33:04.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:33:04.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:33:04.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): port = 5500 2026-02-18T03:33:04.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:33:04.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:33:04.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:33:04.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:33:04.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:33:04.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:33:04.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:33:04.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:33:04.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): force_tls = False 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:33:04.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [discovery] 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): port = 8009 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [ceph] 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): pool = mypool 2026-02-18T03:33:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [mtls] 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [spdk] 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:33:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): transports = tcp 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): [monitor] 2026-02-18T03:33:04.724 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.177:5499 for group id 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:33:04.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:33:04.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:04] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: pgmap v300: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 47 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3889486673' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:04.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:04.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:04.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:33:04.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:33:04.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: pgmap v300: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 47 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3889486673' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:04.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:05.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:33:05.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:05.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:33:05.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:33:06.622 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: INFO: Setting log level to WARNING 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.343735] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.343847] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.459959] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.482107] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.482116] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:33:06.623 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.482125] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:33:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.482126] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:33:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:33:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:33:06.624 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.621484] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:33:06.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:33:06.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:33:06.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:33:06.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:33:06.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:06.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:06 trial086 ceph-mon[73228]: pgmap v301: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 45 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:33:06.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO discovery.py:369 (78): discovery addr: 10.20.193.177 port: 8009 2026-02-18T03:33:06.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.668775] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.668801] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial177). 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial177). 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO state.py:2073 (78): Initialization is over (discovery-trial177). 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:33:06.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:33:06.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:33:06.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:33:06.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:33:06.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:33:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:33:07.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:33:07.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:33:07.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:07.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:33:07.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:06 trial034 ceph-mon[21825]: pgmap v301: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 45 KiB/s rd, 0 B/s wr, 4 op/s 2026-02-18T03:33:07.192 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:33:07.192 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.192 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.977145] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.177:0/1509304218, rc 0 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.977202] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.177:0/1509304218 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.177:0/1509304218' 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.988664] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:06] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.993405] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.993655] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:06.993669] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.102133] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.177:0/2269710524, rc 0 2026-02-18T03:33:07.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.102184] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.177:0/2269710524 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.177:0/2269710524' 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.115123] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.120284] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.120306] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.224605] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.177:0/376057777, rc 0 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.225326] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.177:0/376057777 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.177:0/376057777' 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.237769] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.245550] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.245572] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:07.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.342839] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.177:0/2575803507, rc 0 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.342890] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.177:0/2575803507 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.177:0/2575803507' 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.356486] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.360988] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.361006] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.464883] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.177:0/3702718121, rc 0 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.465318] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.177:0/3702718121 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.177:0/3702718121' 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.479481] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:33:07.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.484044] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.484064] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.584184] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.177:0/4282132829, rc 0 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.584233] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.177:0/4282132829 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.177:0/4282132829' 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.595555] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.600515] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.600535] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:07.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.700344] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.177:0/3388928059, rc 0 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.700394] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.177:0/3388928059 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.177:0/3388928059' 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.713746] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.718811] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:33:07.722 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.718831] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:07.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:07 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2663610754' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:33:07.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:07 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2469630544' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.818987] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.177:0/2313196270, rc 0 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.819037] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.177:0/2313196270 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.177:0/2313196270' 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.831769] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.836303] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.836323] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.017 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.932215] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.177:0/227105658, rc 0 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.932264] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.177:0/227105658 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.177:0/227105658' 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.943978] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:07] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.948495] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:07.948515] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.018 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2663610754' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:33:08.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2469630544' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:08.284 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.048842] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.177:0/2457097060, rc 0 2026-02-18T03:33:08.284 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.049318] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.177:0/2457097060 2026-02-18T03:33:08.284 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.177:0/2457097060' 2026-02-18T03:33:08.284 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.061395] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.284 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.065968] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.065987] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.166060] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.177:0/1508296311, rc 0 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.166111] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.177:0/1508296311 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.177:0/1508296311' 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.177700] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.182663] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.182683] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:08.285 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.286 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.286 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.282744] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.177:0/4150638584, rc 0 2026-02-18T03:33:08.286 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.282794] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.177:0/4150638584 2026-02-18T03:33:08.286 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.177:0/4150638584' 2026-02-18T03:33:08.584 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.295791] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.300830] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.300849] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.397054] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.177:0/1269742889, rc 0 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.397104] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.177:0/1269742889 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.177:0/1269742889' 2026-02-18T03:33:08.585 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.408347] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.412826] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.412845] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.504753] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.177:0/3770745360, rc 0 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.504802] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.177:0/3770745360 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.177:0/3770745360' 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.515927] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.520431] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:33:08.586 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.520450] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:08.587 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.587 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.834 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.612450] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.177:0/3418008687, rc 0 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.612500] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.177:0/3418008687 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.177:0/3418008687' 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.624294] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.628826] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.628845] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.835 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.720864] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.177:0/567288451, rc 0 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.720914] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.177:0/567288451 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.177:0/567288451' 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.732415] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.737504] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.737524] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:08.836 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.833461] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.177:0/443164132, rc 0 2026-02-18T03:33:08.837 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.833511] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.177:0/443164132 2026-02-18T03:33:08.837 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.177:0/443164132' 2026-02-18T03:33:08.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:08 trial086 ceph-mon[73228]: pgmap v302: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 102 B/s wr, 17 op/s 2026-02-18T03:33:08.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:08 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:09.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:08 trial034 ceph-mon[21825]: pgmap v302: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 102 B/s wr, 17 op/s 2026-02-18T03:33:09.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:08 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:33:09.142 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.845189] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.142 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:33:09.142 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.850183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:33:09.142 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.850202] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.946515] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.177:0/2352862267, rc 0 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.946569] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.177:0/2352862267 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.177:0/2352862267' 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.959625] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:08] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.964170] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:08.964190] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.143 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.059958] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.177:0/248753803, rc 0 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.060008] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.177:0/248753803 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.177:0/248753803' 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.072318] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.076865] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.076885] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.144 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.168747] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.177:0/1920294405, rc 0 2026-02-18T03:33:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.168796] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.177:0/1920294405 2026-02-18T03:33:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.177:0/1920294405' 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.182245] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.186805] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.186824] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.283258] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.177:0/2928643256, rc 0 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.283312] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.177:0/2928643256 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.177:0/2928643256' 2026-02-18T03:33:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.294326] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.299104] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.299124] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.394971] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.177:0/4027953954, rc 0 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.395025] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.177:0/4027953954 2026-02-18T03:33:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.177:0/4027953954' 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.406273] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.411193] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.411212] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.507378] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.177:0/1693898168, rc 0 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.507431] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.177:0/1693898168 2026-02-18T03:33:09.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.177:0/1693898168' 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.519876] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.524445] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.524464] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.629904] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.177:0/118559541, rc 0 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.629954] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.177:0/118559541 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.177:0/118559541' 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.643017] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:33:09.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.647535] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:33:09.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.647553] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:09.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.744167] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.177:0/943174829, rc 0 2026-02-18T03:33:09.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.744216] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.177:0/943174829 2026-02-18T03:33:09.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.177:0/943174829' 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.756044] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.760520] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.760539] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.852623] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.177:0/450576424, rc 0 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.852673] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.177:0/450576424 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.177:0/450576424' 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.864905] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:33:09.939 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.869768] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:33:09.940 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.869788] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:09.940 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:09.940 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.965543] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.177:0/3092837272, rc 0 2026-02-18T03:33:10.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.965594] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.177:0/3092837272 2026-02-18T03:33:10.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.177:0/3092837272' 2026-02-18T03:33:10.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.978900] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:09] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.983806] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:09.983825] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.079741] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.177:0/40724171, rc 0 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.080318] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.177:0/40724171 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.177:0/40724171' 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.092360] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:33:10.199 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.096865] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.096884] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.196979] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.177:0/4097672921, rc 0 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.197032] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.177:0/4097672921 2026-02-18T03:33:10.200 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.177:0/4097672921' 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.208181] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.212717] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.212736] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.308726] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.177:0/252248299, rc 0 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.308778] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.177:0/252248299 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.177:0/252248299' 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.320139] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.324666] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.324687] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.424785] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.177:0/2654840066, rc 0 2026-02-18T03:33:10.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.424834] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.177:0/2654840066 2026-02-18T03:33:10.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.177:0/2654840066' 2026-02-18T03:33:10.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.436570] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:33:10.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.441104] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:33:10.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.441124] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.541169] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.177:0/3413173148, rc 0 2026-02-18T03:33:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.541337] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.177:0/3413173148 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.177:0/3413173148' 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.552864] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.557665] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.557686] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.660231] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.664786] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:33:10.767 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.664806] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:10.768 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:10.768 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:10.768 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.764735] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:10.768 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:33:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:10 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/235421899' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:10 trial086 ceph-mon[73228]: pgmap v303: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 140 KiB/s rd, 716 B/s wr, 110 op/s 2026-02-18T03:33:10.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:10 trial086 ceph-mon[73228]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:33:11.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/235421899' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:11.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-mon[21825]: pgmap v303: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 140 KiB/s rd, 716 B/s wr, 110 op/s 2026-02-18T03:33:11.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-mon[21825]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:33:10] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:33:11.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:39116 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.599571] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000162 seconds 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.615484] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000123 seconds 2026-02-18T03:33:11.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.631522] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000169 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.647513] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000158 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.663484] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000137 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.679488] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000133 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.695500] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000146 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.711525] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000139 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.727514] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000163 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.743505] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000150 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.767511] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000157 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.783504] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000141 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.799489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000129 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.815496] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000139 seconds 2026-02-18T03:33:11.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.831529] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000167 seconds 2026-02-18T03:33:11.050 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.769139] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:33:11.050 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.769159] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.873330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.877665] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.877686] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.980357] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:10] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.984748] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:33:11.051 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:10.984767] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:11.052 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.052 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.359 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.084812] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.089204] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.089223] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.187471] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.191845] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.191865] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:11.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.289468] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.294014] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.294033] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.667 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.392743] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.397135] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.397153] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.492329] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.497526] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:33:11.668 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.497548] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.597340] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.601672] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.601692] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.669 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:11.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme12n3 2026-02-18T03:33:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme16n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme20n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme24n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme28n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme32n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme36n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme40n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme44n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme48n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme4n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme52n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme56n3 2026-02-18T03:33:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme60n3 2026-02-18T03:33:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme64n3 2026-02-18T03:33:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2026-02-18T03:33:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:11 trial086 ceph-mon[73228]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.699996] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.704523] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.704542] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.800361] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.804745] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.804764] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.900154] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.904552] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:33:11.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.904571] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:12.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:11 trial034 ceph-mon[21825]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:33:12.280 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.280 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.280 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:11.998690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.280 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:11] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:33:12.280 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.003034] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.003053] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.101771] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.106270] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.106291] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.208264] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.281 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:33:12.282 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.212876] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:33:12.282 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.212895] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:12.282 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.282 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.311862] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.316483] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.316503] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.416403] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.420922] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:33:12.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.420942] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.519353] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.523842] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.523861] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.631702] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.636359] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.636379] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.847 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.738569] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.743183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.743203] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.841329] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.845846] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:33:12.848 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.845867] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:12.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:12 trial086 ceph-mon[73228]: pgmap v305: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 347 KiB/s rd, 1.7 KiB/s wr, 338 op/s 2026-02-18T03:33:13.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:12 trial034 ceph-mon[21825]: pgmap v305: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 347 KiB/s rd, 1.7 KiB/s wr, 338 op/s 2026-02-18T03:33:13.117 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.946620] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:12] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.951098] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:12 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:12.951117] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.049287] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.118 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:33:13.119 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.053870] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:33:13.119 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.053889] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:13.119 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.119 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.154476] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.159032] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.159051] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.260691] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.265093] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.265113] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:13.431 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.359266] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.363662] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.363681] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.432 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.465331] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.470526] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.470546] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.572430] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.576803] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:33:13.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.576823] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.674253] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.678614] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:33:13.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.678633] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.781663] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.786046] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.786065] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:33:14.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.895202] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.899638] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.899659] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:13.971462] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.177 port 4420 *** 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.004 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:13 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:13] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.470 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.471 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:33:14.472 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:14] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:33:14.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:14 trial086 ceph-mon[73228]: pgmap v306: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 572 KiB/s rd, 3.2 KiB/s wr, 587 op/s 2026-02-18T03:33:15.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:14 trial034 ceph-mon[21825]: pgmap v306: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 572 KiB/s rd, 3.2 KiB/s wr, 587 op/s 2026-02-18T03:33:15.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:15 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/15721220' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:15] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.878 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.879 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:33:15.880 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.881 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 4 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:50180 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.611777] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000247 seconds 2026-02-18T03:33:15.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.627663] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000158 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.643667] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000166 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.659698] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000198 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.675725] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000224 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.699701] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000201 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.715674] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000174 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.731682] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000177 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.747669] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000168 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.763679] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000177 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.779678] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000175 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.795758] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000256 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.811664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000163 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.827703] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000201 seconds 2026-02-18T03:33:15.885 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.843664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000164 seconds 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:33:15] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:33:15.886 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.887 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:33:15.888 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.889 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:50184 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.859645] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000143 seconds 2026-02-18T03:33:15.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.875690] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000188 seconds 2026-02-18T03:33:16.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/15721220' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.891652] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000146 seconds 2026-02-18T03:33:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.907668] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000165 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.923687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000183 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.939679] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000178 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.955681] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000178 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.971655] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000153 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.987753] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000251 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.003650] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000149 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.019684] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000181 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.043670] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000168 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.059665] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000163 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.075660] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000157 seconds 2026-02-18T03:33:16.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.091762] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000260 seconds 2026-02-18T03:33:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:16 trial034 ceph-mon[21825]: pgmap v307: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 743 KiB/s rd, 4.2 KiB/s wr, 779 op/s 2026-02-18T03:33:17.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/279972305' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:16 trial086 ceph-mon[73228]: pgmap v307: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 743 KiB/s rd, 4.2 KiB/s wr, 779 op/s 2026-02-18T03:33:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/279972305' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:18.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:33:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:18.498406] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:33:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:18 trial034 ceph-mon[21825]: pgmap v308: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 843 KiB/s rd, 4.6 KiB/s wr, 880 op/s 2026-02-18T03:33:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:18 trial086 ceph-mon[73228]: pgmap v308: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 843 KiB/s rd, 4.6 KiB/s wr, 880 op/s 2026-02-18T03:33:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:20 trial034 ceph-mon[21825]: pgmap v309: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 946 KiB/s rd, 173 KiB/s wr, 828 op/s 2026-02-18T03:33:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:20 trial086 ceph-mon[73228]: pgmap v309: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 946 KiB/s rd, 173 KiB/s wr, 828 op/s 2026-02-18T03:33:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:21.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 70.30 1.0M 1.0M 0.0k 10.2M 10.4M 0.0k nvme12n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 72.70 1.1M 1.0M 0.0k 10.5M 10.3M 0.0k nvme16n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 65.40 845.6k 1000.0k 0.0k 8.3M 9.8M 0.0k nvme20n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 68.90 973.2k 962.8k 0.0k 9.5M 9.4M 0.0k nvme24n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 71.80 1.1M 1.1M 0.0k 10.5M 10.5M 0.0k nvme28n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 67.90 1007.2k 948.0k 0.0k 9.8M 9.3M 0.0k nvme32n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 68.20 917.2k 982.4k 0.0k 9.0M 9.6M 0.0k nvme36n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 70.00 1021.6k 1.0M 0.0k 10.0M 10.5M 0.0k nvme40n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 68.20 923.2k 1.0M 0.0k 9.0M 10.1M 0.0k nvme44n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 70.60 1.0M 930.4k 0.0k 10.3M 9.1M 0.0k nvme48n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 71.50 1.0M 1009.6k 0.0k 10.5M 9.9M 0.0k nvme4n3 2026-02-18T03:33:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 69.80 1.1M 917.6k 0.0k 10.7M 9.0M 0.0k nvme52n3 2026-02-18T03:33:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 72.80 1.1M 999.6k 0.0k 11.1M 9.8M 0.0k nvme56n3 2026-02-18T03:33:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 70.80 1020.8k 1006.0k 0.0k 10.0M 9.8M 0.0k nvme60n3 2026-02-18T03:33:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 68.80 1019.6k 992.4k 0.0k 10.0M 9.7M 0.0k nvme64n3 2026-02-18T03:33:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 67.10 927.2k 991.6k 0.0k 9.1M 9.7M 0.0k nvme8n3 2026-02-18T03:33:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:22.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2276372446' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:21 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2276372446' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:22 trial034 ceph-mon[21825]: pgmap v310: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 982 op/s 2026-02-18T03:33:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:22 trial086 ceph-mon[73228]: pgmap v310: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 982 op/s 2026-02-18T03:33:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1886007673' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:23 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1886007673' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:24 trial034 ceph-mon[21825]: pgmap v311: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 1.39k op/s 2026-02-18T03:33:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:24 trial086 ceph-mon[73228]: pgmap v311: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 1.39k op/s 2026-02-18T03:33:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:26 trial034 ceph-mon[21825]: pgmap v312: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2026-02-18T03:33:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:26 trial086 ceph-mon[73228]: pgmap v312: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2026-02-18T03:33:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:28 trial034 ceph-mon[21825]: pgmap v313: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 27 MiB/s wr, 2.09k op/s 2026-02-18T03:33:29.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2730433110' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:28 trial086 ceph-mon[73228]: pgmap v313: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 27 MiB/s wr, 2.09k op/s 2026-02-18T03:33:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2730433110' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:30 trial034 ceph-mon[21825]: pgmap v314: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 2.56k op/s 2026-02-18T03:33:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3056269709' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:30 trial086 ceph-mon[73228]: pgmap v314: 33 pgs: 33 active+clean; 16 GiB data, 31 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 2.56k op/s 2026-02-18T03:33:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:30 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3056269709' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:31.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:31.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 227.10 3.2M 3.2M 0.0k 32.1M 31.7M 0.0k nvme12n3 2026-02-18T03:33:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 231.00 3.3M 3.2M 0.0k 32.9M 31.8M 0.0k nvme16n3 2026-02-18T03:33:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 220.50 3.1M 3.1M 0.0k 30.5M 31.5M 0.0k nvme20n3 2026-02-18T03:33:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 227.10 3.2M 3.2M 0.0k 31.9M 31.7M 0.0k nvme24n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 217.10 2.9M 3.1M 0.0k 28.9M 31.3M 0.0k nvme28n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.30 3.2M 3.1M 0.0k 32.2M 30.6M 0.0k nvme32n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.70 3.1M 3.1M 0.0k 30.6M 31.3M 0.0k nvme36n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 218.20 2.9M 3.2M 0.0k 29.4M 31.5M 0.0k nvme40n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 216.90 3.0M 3.1M 0.0k 29.7M 30.8M 0.0k nvme44n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.00 3.1M 3.2M 0.0k 31.4M 31.5M 0.0k nvme48n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.00 3.1M 3.2M 0.0k 30.6M 31.6M 0.0k nvme4n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 224.20 3.2M 3.2M 0.0k 32.4M 31.8M 0.0k nvme52n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 229.80 3.2M 3.2M 0.0k 32.2M 32.0M 0.0k nvme56n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.00 3.2M 3.1M 0.0k 31.6M 30.8M 0.0k nvme60n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 224.70 3.1M 3.1M 0.0k 31.2M 31.1M 0.0k nvme64n3 2026-02-18T03:33:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.60 3.0M 3.2M 0.0k 30.5M 31.5M 0.0k nvme8n3 2026-02-18T03:33:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:32 trial034 ceph-mon[21825]: pgmap v315: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.19k op/s 2026-02-18T03:33:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:32 trial086 ceph-mon[73228]: pgmap v315: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.19k op/s 2026-02-18T03:33:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:34 trial034 ceph-mon[21825]: pgmap v316: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:33:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:34 trial086 ceph-mon[73228]: pgmap v316: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:33:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3404900250' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3404900250' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:36 trial034 ceph-mon[21825]: pgmap v317: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.51k op/s 2026-02-18T03:33:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:36 trial086 ceph-mon[73228]: pgmap v317: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.51k op/s 2026-02-18T03:33:38.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/520951224' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:37 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/520951224' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:38 trial034 ceph-mon[21825]: pgmap v318: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.65k op/s 2026-02-18T03:33:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:38 trial086 ceph-mon[73228]: pgmap v318: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.65k op/s 2026-02-18T03:33:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:40 trial034 ceph-mon[21825]: pgmap v319: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.61k op/s 2026-02-18T03:33:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:40 trial086 ceph-mon[73228]: pgmap v319: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.61k op/s 2026-02-18T03:33:41.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.20 2.9M 3.1M 0.0k 29.4M 30.6M 0.0k nvme12n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.80 3.0M 3.1M 0.0k 29.7M 31.3M 0.0k nvme16n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 236.50 3.2M 3.0M 0.0k 31.9M 30.5M 0.0k nvme20n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 224.10 3.0M 3.0M 0.0k 30.2M 30.2M 0.0k nvme24n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.10 3.0M 3.1M 0.0k 30.0M 30.7M 0.0k nvme28n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 233.40 3.1M 3.0M 0.0k 30.9M 29.8M 0.0k nvme32n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.30 2.9M 2.9M 0.0k 29.1M 29.4M 0.0k nvme36n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.40 3.0M 2.9M 0.0k 30.2M 29.3M 0.0k nvme40n3 2026-02-18T03:33:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 230.60 3.2M 3.0M 0.0k 31.9M 30.2M 0.0k nvme44n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 220.90 2.9M 3.0M 0.0k 28.9M 30.3M 0.0k nvme48n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 235.60 3.3M 3.0M 0.0k 33.1M 30.1M 0.0k nvme4n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 227.20 3.1M 3.0M 0.0k 31.5M 30.0M 0.0k nvme52n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 233.20 3.3M 3.1M 0.0k 33.1M 31.5M 0.0k nvme56n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 223.10 3.1M 2.9M 0.0k 31.1M 29.2M 0.0k nvme60n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 224.30 3.1M 3.1M 0.0k 31.5M 30.5M 0.0k nvme64n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 221.20 2.8M 3.0M 0.0k 27.8M 29.7M 0.0k nvme8n3 2026-02-18T03:33:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:42 trial034 ceph-mon[21825]: pgmap v320: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.70k op/s 2026-02-18T03:33:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3993804972' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:42 trial086 ceph-mon[73228]: pgmap v320: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.70k op/s 2026-02-18T03:33:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3993804972' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:44 trial034 ceph-mon[21825]: pgmap v321: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.75k op/s 2026-02-18T03:33:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4090319733' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:44 trial086 ceph-mon[73228]: pgmap v321: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.75k op/s 2026-02-18T03:33:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/4090319733' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:46 trial034 ceph-mon[21825]: pgmap v322: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.51k op/s 2026-02-18T03:33:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:46 trial086 ceph-mon[73228]: pgmap v322: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.51k op/s 2026-02-18T03:33:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:48 trial034 ceph-mon[21825]: pgmap v323: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.63k op/s 2026-02-18T03:33:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:48 trial086 ceph-mon[73228]: pgmap v323: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.63k op/s 2026-02-18T03:33:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2995077022' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:49 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2995077022' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:50 trial034 ceph-mon[21825]: pgmap v324: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.58k op/s 2026-02-18T03:33:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:50 trial086 ceph-mon[73228]: pgmap v324: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.58k op/s 2026-02-18T03:33:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 222.00 2.8M 3.0M 0.0k 28.2M 29.5M 0.0k nvme12n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 225.70 3.0M 2.9M 0.0k 29.6M 29.5M 0.0k nvme16n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 239.60 3.2M 2.9M 0.0k 32.3M 28.9M 0.0k nvme20n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 223.60 2.8M 2.9M 0.0k 28.3M 29.0M 0.0k nvme24n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 216.60 2.8M 2.9M 0.0k 27.9M 29.3M 0.0k nvme28n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 226.70 2.8M 2.8M 0.0k 28.2M 28.3M 0.0k nvme32n3 2026-02-18T03:33:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 218.10 2.8M 2.9M 0.0k 27.9M 28.9M 0.0k nvme36n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.90 2.9M 2.9M 0.0k 29.0M 28.9M 0.0k nvme40n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.80 2.9M 3.0M 0.0k 29.1M 29.6M 0.0k nvme44n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 232.90 3.0M 2.9M 0.0k 29.8M 29.1M 0.0k nvme48n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.30 2.9M 2.9M 0.0k 28.7M 28.9M 0.0k nvme4n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.60 2.9M 2.9M 0.0k 28.8M 28.5M 0.0k nvme52n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 211.70 2.7M 2.9M 0.0k 27.0M 29.4M 0.0k nvme56n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.60 2.7M 2.9M 0.0k 27.1M 28.8M 0.0k nvme60n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 219.20 2.8M 2.9M 0.0k 27.8M 28.8M 0.0k nvme64n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 220.00 2.9M 2.9M 0.0k 28.7M 28.8M 0.0k nvme8n3 2026-02-18T03:33:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:33:52.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:51 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2707917215' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:51 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2707917215' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:52 trial034 ceph-mon[21825]: pgmap v325: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.67k op/s 2026-02-18T03:33:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:52 trial086 ceph-mon[73228]: pgmap v325: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.67k op/s 2026-02-18T03:33:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:54 trial034 ceph-mon[21825]: pgmap v326: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.73k op/s 2026-02-18T03:33:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:54 trial086 ceph-mon[73228]: pgmap v326: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.73k op/s 2026-02-18T03:33:57.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:56 trial034 ceph-mon[21825]: pgmap v327: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.49k op/s 2026-02-18T03:33:57.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:56 trial086 ceph-mon[73228]: pgmap v327: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.49k op/s 2026-02-18T03:33:58.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2298242160' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:58.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:57 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2298242160' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:33:59.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:58 trial034 ceph-mon[21825]: pgmap v328: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:33:59.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:58 trial086 ceph-mon[73228]: pgmap v328: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:34:00.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:33:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/823239863' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:00.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:33:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/823239863' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:01.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:00 trial034 ceph-mon[21825]: pgmap v329: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.60k op/s 2026-02-18T03:34:01.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:00 trial086 ceph-mon[73228]: pgmap v329: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.60k op/s 2026-02-18T03:34:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 220.30 2.6M 2.9M 0.0k 25.9M 28.6M 0.0k nvme12n3 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 232.40 3.0M 2.8M 0.0k 29.7M 28.0M 0.0k nvme16n3 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 228.80 2.9M 2.8M 0.0k 29.4M 27.7M 0.0k nvme20n3 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 221.00 2.8M 2.7M 0.0k 27.8M 27.4M 0.0k nvme24n3 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 221.40 2.7M 2.8M 0.0k 27.3M 27.9M 0.0k nvme28n3 2026-02-18T03:34:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 230.30 2.8M 2.8M 0.0k 28.0M 27.7M 0.0k nvme32n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.60 2.8M 2.8M 0.0k 28.5M 28.2M 0.0k nvme36n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 225.60 2.8M 3.0M 0.0k 27.5M 29.9M 0.0k nvme40n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.60 2.8M 2.9M 0.0k 27.7M 29.1M 0.0k nvme44n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.80 2.7M 2.8M 0.0k 27.2M 27.6M 0.0k nvme48n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 227.40 3.0M 2.8M 0.0k 29.6M 28.1M 0.0k nvme4n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 231.10 3.0M 2.9M 0.0k 29.7M 28.8M 0.0k nvme52n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 222.20 2.7M 2.7M 0.0k 27.2M 27.4M 0.0k nvme56n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.10 2.8M 2.7M 0.0k 27.5M 26.8M 0.0k nvme60n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 215.70 2.7M 2.9M 0.0k 26.8M 28.7M 0.0k nvme64n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 231.20 2.9M 2.8M 0.0k 28.8M 28.1M 0.0k nvme8n3 2026-02-18T03:34:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:02 trial034 ceph-mon[21825]: pgmap v330: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.70k op/s 2026-02-18T03:34:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:02 trial086 ceph-mon[73228]: pgmap v330: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.70k op/s 2026-02-18T03:34:04.097 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:34:04.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2186143435' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2186143435' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:04.447 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #2: thrashed- nvmeof.b, nvmeof.c (by ceph_daemon_stop); nvmeof.d (by daemon_remove); 2026-02-18T03:34:04.448 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:34:04.448 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:34:04.475 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:31:26 UTC; 2min 38s ago 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80884 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80885 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 80963 (conmon) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 335.5M (peak: 338.7M) 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 10min 22.709s 2026-02-18T03:34:04.476 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80965 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80967 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80985 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─81480 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: │ └─81534 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: └─80963 /usr/bin/conmon --api-version 1 -c fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -u fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata -p /run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:34:04.477 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.679488] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000133 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.695500] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000146 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.711525] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000139 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.727514] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000163 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.743505] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000150 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.767511] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000157 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.783504] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000141 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.799489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000129 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.815496] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000139 seconds 2026-02-18T03:34:04.478 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:33:10 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:33:10.831529] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000167 seconds 2026-02-18T03:34:04.479 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:34:04.511 INFO:teuthology.orchestra.run.trial086.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Active: inactive (dead) since Wed 2026-02-18 03:32:49 UTC; 1min 15s ago 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Duration: 2min 42.358s 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62368 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Process: 62369 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Process: 74422 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Process: 74490 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.512 INFO:teuthology.orchestra.run.trial086.stdout: Process: 74525 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 62448 (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 10min 46.963s 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:34:04.513 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[62448]: [18-Feb-2026 03:32:49] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 podman[74455]: 2026-02-18 03:32:49.350987504 +0000 UTC m=+1.866545940 container died 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.component=ceph-nvmeof, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, org.centos.version=9.0-30.el9, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, version=1.6.5, distribution-scope=public, url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.spdk.version=25.09, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , vcs-type=git, com.redhat.component=ubi9-container, name=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=) 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 podman[74455]: 2026-02-18 03:32:49.364441301 +0000 UTC m=+1.879999737 container remove 4cd4a5649af8c7c5d3ecdf2ac945b72aa549dde8108071a021ca2424705e2185 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.version=9.0-30.el9, io.ceph.version=1.6.5, io.spdk.build.makeflags=, io.spdk.version=25.09, io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vendor=Red Hat, Inc., io.ceph.nvmeof=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, version=1.6.5, io.ceph.maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, build-date=2026-02-11 09:53:49 UTC) 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 bash[74455]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:34:04.514 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:32:49 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 10min 46.963s CPU time, 340.5M memory peak. 2026-02-18T03:34:04.515 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:34:04.516 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:34:04.549 INFO:teuthology.orchestra.run.trial155.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:04.549 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:34:04.549 INFO:teuthology.orchestra.run.trial155.stdout: Active: inactive (dead) since Wed 2026-02-18 03:33:02 UTC; 1min 1s ago 2026-02-18T03:34:04.549 INFO:teuthology.orchestra.run.trial155.stdout: Duration: 2min 53.439s 2026-02-18T03:34:04.549 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64083 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: Process: 64084 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: Process: 75656 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: Process: 75724 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: Process: 75760 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 64163 (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 11min 22.985s 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:34:04.550 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[64163]: [18-Feb-2026 03:33:02] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 podman[75690]: 2026-02-18 03:33:02.908419271 +0000 UTC m=+0.266579208 container died 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.version=25.09, io.openshift.wants=ceph,rbd, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-type=git, io.spdk.build.target-arch=x86-64-v2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.branch=devel, io.spdk.build.makeflags=, io.ceph.version=1.6.5, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, org.centos.version=9.0-30.el9, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, version=1.6.5, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git) 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 podman[75690]: 2026-02-18 03:33:02.919980775 +0000 UTC m=+0.278140711 container remove 7f7bbf3f011bcb98ad18caeb02a37ec25038849916eb3bea557fdc64c3ba93eb (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, name=ceph-nvmeof, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, vendor=Red Hat, Inc., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=undefined, maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.buildah.version=1.29.0, io.spdk.build.makeflags=, io.spdk.version=25.09, io.ceph.git.branch=devel, release=, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.component=ceph-nvmeof, io.openshift.wants=ceph,rbd, distribution-scope=public, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64) 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 bash[75690]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:34:04.551 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:33:02 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 11min 22.985s CPU time, 331.1M memory peak. 2026-02-18T03:34:04.552 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:34:04.552 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:34:04.585 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:33:04 UTC; 1min 0s ago 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Process: 38731 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Process: 38732 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 38809 (conmon) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 342.6M (peak: 343.8M) 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 4min 3.276s 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:34:04.586 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38811 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38813 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38905 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─39111 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: │ └─39116 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: └─38809 /usr/bin/conmon --api-version 1 -c dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa -u dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata -p /run/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.955681] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000178 seconds 2026-02-18T03:34:04.587 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.971655] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000153 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:15.987753] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000251 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.003650] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000149 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.019684] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000181 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.043670] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000168 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.059665] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000163 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.075660] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000157 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:16 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:16.091762] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000260 seconds 2026-02-18T03:34:04.588 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:33:18 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:33:18.498406] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:34:04.589 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:34:04.811 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:34:04.811 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 2m ago 9m trial034=x;count:1 2026-02-18T03:34:04.811 INFO:teuthology.orchestra.run.trial177.stdout:mon 2/3 2m ago 9m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:34:04.811 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 2/4 2m ago 7m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:34:04.811 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 2m ago 7m trial155 2026-02-18T03:34:04.819 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:34:05.008 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:34:05.008 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (2m) 2m ago 7m 54.8M - 1.6.5 99a57256b38c fcedd7379c32 2026-02-18T03:34:05.008 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 stopped 61s ago 3m - - 2026-02-18T03:34:05.008 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 stopped 61s ago 3m - - 2026-02-18T03:34:05.008 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (60s) 60s ago 60s 53.7M - 1.6.5 99a57256b38c dab76d38e575 2026-02-18T03:34:05.017 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:34:05.241 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,b; 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:05.241 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:34:05.241 INFO:teuthology.orchestra.run.trial177.stdout: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:34:05.241 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:05.242 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:34:05.250 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:34:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:04 trial034 ceph-mon[21825]: pgmap v331: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:34:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:04 trial086 ceph-mon[73228]: pgmap v331: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:34:05.469 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:34:05.469 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:05.469 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,b 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,b (age 63s) [leader: a], out of quorum: c 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 9m) 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 7m), 8 in (since 7m) 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 2 gateways active (2 hosts) 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:34:05.470 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: usage: 34 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: client: 45 MiB/s rd, 47 MiB/s wr, 1.87k op/s rd, 1.88k op/s wr 2026-02-18T03:34:05.471 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:34:05.478 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:34:05.718 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:34:05.718 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 134, 2026-02-18T03:34:05.718 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 3, 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 50, 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:34:05.719 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:34:05.720 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "CREATED", 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:34:05.721 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: ACTIVE " 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:34:05.722 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:34:05.727 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:34:05.784 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:34:05.784 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:34:05.784 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:34:05.784 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.785 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.786 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.787 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.788 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.789 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.790 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.790 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.790 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.790 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.790 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:34:05.791 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:34:05.839 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:05.840 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:34:05.887 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:05.888 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:34:05.935 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:05.936 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:34:05.982 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:05.983 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:34:06.027 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.029 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:34:06.073 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.075 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:34:06.120 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.122 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:34:06.167 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.168 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:34:06.214 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.214 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:34:06.260 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.260 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:34:06.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.60053 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3977479750' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3913969128' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1030433777' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:34:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/252136487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:06.305 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.306 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:34:06.350 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.351 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.60053 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3977479750' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3913969128' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1030433777' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:34:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:05 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/252136487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:06.395 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.396 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:34:06.441 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.441 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:34:06.487 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.487 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:34:06.531 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.532 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:34:06.615 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.616 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:34:06.660 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.661 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:34:06.706 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.707 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:34:06.751 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.753 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:34:06.798 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.799 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:34:06.843 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.844 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:34:06.929 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.930 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:34:06.976 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:06.976 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:34:07.022 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.023 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:34:07.068 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.069 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:34:07.114 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.114 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:34:07.160 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.161 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:34:07.206 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.207 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:34:07.252 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.253 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:34:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:06 trial034 ceph-mon[21825]: pgmap v332: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.50k op/s 2026-02-18T03:34:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:06 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:07.298 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.298 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:34:07.342 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.344 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:34:07.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:06 trial086 ceph-mon[73228]: pgmap v332: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.50k op/s 2026-02-18T03:34:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:06 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:07.389 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.389 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:34:07.433 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.434 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:34:07.477 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.478 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:34:07.523 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.523 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:34:07.568 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.569 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:34:07.614 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.615 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:34:07.661 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.661 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:34:07.706 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.707 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:34:07.753 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.754 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:34:07.800 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.801 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:34:07.845 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.847 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:34:07.892 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.892 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:34:07.978 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:07.979 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:34:08.024 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.024 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:34:08.070 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.071 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:34:08.117 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.117 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:34:08.162 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.162 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:34:08.207 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.208 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:34:08.292 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.293 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:34:08.338 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.339 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:34:08.382 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.383 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:34:08.468 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.468 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:34:08.514 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.515 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:34:08.561 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.561 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:34:08.607 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.608 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:34:08.653 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.654 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:34:08.699 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.700 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:34:08.747 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.748 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:34:08.793 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.794 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:34:08.838 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.839 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:34:08.883 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.884 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:34:08.928 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:34:08.929 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:34:08.930 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:34:08.930 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.b 2026-02-18T03:34:08.930 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon restart nvmeof.nvmeof.b --force 2026-02-18T03:34:08.931 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:34:08.931 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.c 2026-02-18T03:34:08.931 INFO:tasks.cephadm.mon.c:Restarting mon.c (starting--it wasn't running)... 2026-02-18T03:34:08.931 DEBUG:teuthology.orchestra.run.trial155:mon.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service 2026-02-18T03:34:08.934 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:34:09.143 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to restart nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:34:09.154 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.c 2026-02-18T03:34:09.154 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon restart nvmeof.nvmeof.c --force 2026-02-18T03:34:09.163 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:34:09.163 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 systemd[1]: Starting Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 podman[76379]: 2026-02-18 03:34:09.116055883 +0000 UTC m=+0.017081536 container create eb98ca0617cc01a77c1614b854d4068f387a0fb5cac0dbd224860cff7566abd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, ceph=True, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2) 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 podman[76379]: 2026-02-18 03:34:09.148491609 +0000 UTC m=+0.049517272 container init eb98ca0617cc01a77c1614b854d4068f387a0fb5cac0dbd224860cff7566abd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 podman[76379]: 2026-02-18 03:34:09.151990822 +0000 UTC m=+0.053016485 container start eb98ca0617cc01a77c1614b854d4068f387a0fb5cac0dbd224860cff7566abd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, ceph=True, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug) 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 bash[76379]: eb98ca0617cc01a77c1614b854d4068f387a0fb5cac0dbd224860cff7566abd4 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 podman[76379]: 2026-02-18 03:34:09.109778849 +0000 UTC m=+0.010804522 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:34:09.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 systemd[1]: Started Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:34:09.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:34:09.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:34:09.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pidfile_write: ignore empty --pid-file 2026-02-18T03:34:09.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: load: jerasure load: lrc 2026-02-18T03:34:09.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:34:09.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Git sha 0 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: DB SUMMARY 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: DB Session ID: CX0E3IETD0D2SBHRMG5N 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: MANIFEST file: MANIFEST-000010 size: 893 Bytes 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000021.sst 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000019.log size: 3158450 ; 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:34:09.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.env: 0x5644f1203100 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.info_log: 0x5644f7920e80 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.statistics: (nil) 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.use_fsync: 0 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:34:09.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.db_log_dir: 2026-02-18T03:34:09.234 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.wal_dir: 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.write_buffer_manager: 0x5644f7924b40 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:34:09.235 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.unordered_write: 0 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.row_cache: None 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.wal_filter: None 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:34:09.236 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.wal_compression: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:34:09.237 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:34:09.238 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_open_files: -1 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Compression algorithms supported: 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kZSTD supported: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:34:09.239 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.merge_operator: 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_filter: None 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:34:09.240 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5644f79203c0) 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: index_type: 0 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_index_type: 0 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: index_shortening: 1 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: checksum: 4 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: no_block_cache: 0 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache: 0x5644f7941b90 2026-02-18T03:34:09.241 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_options: 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: capacity : 536870912 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: num_shard_bits : 4 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: strict_capacity_limit : 0 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_compressed: (nil) 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: persistent_cache: (nil) 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size: 4096 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size_deviation: 10 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: block_restart_interval: 16 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: index_block_restart_interval: 1 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: metadata_block_size: 4096 2026-02-18T03:34:09.242 INFO:journalctl@ceph.mon.c.trial155.stdout: partition_filters: 0 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: use_delta_encoding: 1 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: filter_policy: bloomfilter 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: whole_key_filtering: 1 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: verify_compression: 0 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: format_version: 5 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_index_compression: 1 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: block_align: 0 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: max_auto_readahead_size: 262144 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: prepopulate_block_cache: 0 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:34:09.243 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression: NoCompression 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.num_levels: 7 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:34:09.244 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:34:09.245 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:34:09.246 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:34:09.247 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:34:09.248 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.ttl: 2592000 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:34:09.249 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 23, last_sequence is 10287, log_number is 19,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 19 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 19 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 711ce751-a115-4d3b-ae33-6c3f58e6c51c 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385649183962, "job": 1, "event": "recovery_started", "wal_files": [19]} 2026-02-18T03:34:09.250 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #19 mode 2 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385649190749, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 2007055, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10292, "largest_seqno": 12229, "table_properties": {"data_size": 1998698, "index_size": 5461, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 15792, "raw_average_key_size": 21, "raw_value_size": 1982964, "raw_average_value_size": 2738, "num_data_blocks": 248, "num_entries": 724, "num_filter_entries": 724, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771385649, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "711ce751-a115-4d3b-ae33-6c3f58e6c51c", "db_session_id": "CX0E3IETD0D2SBHRMG5N", "orig_file_number": 24, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385649190836, "job": 1, "event": "recovery_finished"} 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:5047] Creating manifest 26 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000019.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5644f7944700 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: DB pointer 0x5644f7956000 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout: ** DB Stats ** 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:34:09.251 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:34:09.252 INFO:journalctl@ceph.mon.c.trial155.stdout: L0 1/0 1.91 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 594.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: L6 1/0 6.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: Sum 2/0 8.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 594.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 594.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 594.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.253 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Flush(GB): cumulative 0.002, interval 0.002 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative compaction: 0.00 GB write, 205.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval compaction: 0.00 GB write, 205.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache BinnedLRUCache@0x5644f7941b90#2 capacity: 512.00 MB usage: 8.12 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.4e-05 secs_since: 0 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.04 KB,0.00038892%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.254 INFO:journalctl@ceph.mon.c.trial155.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: starting mon.c rank 1 at public addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] at bind addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).mds e1 new map 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).mds e1 print_map 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: e1 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: legacy client fscid: -1 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout: No filesystems configured 2026-02-18T03:34:09.255 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).osd e52 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:34:09.256 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:34:09.256 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:34:09.256 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:34:09.256 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: mon.c@-1(???).paxosservice(auth 1..29) refresh upgraded, format 0 -> 3 2026-02-18T03:34:09.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:08 trial034 ceph-mon[21825]: pgmap v333: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.64k op/s 2026-02-18T03:34:09.370 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to restart nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:34:09.372 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:08 trial086 ceph-mon[73228]: pgmap v333: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.64k op/s 2026-02-18T03:34:09.381 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.d 2026-02-18T03:34:09.381 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon start nvmeof.nvmeof.d 2026-02-18T03:34:09.407 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":24,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":66,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:34:09.570 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to start nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:34:09.579 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 83 secs before thrashing 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v315: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.19k op/s 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v316: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3404900250' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v317: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.51k op/s 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/520951224' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v318: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.65k op/s 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v319: 33 pgs: 33 active+clean; 16 GiB data, 32 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.61k op/s 2026-02-18T03:34:09.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v320: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.70k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3993804972' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v321: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 50 MiB/s wr, 3.75k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/4090319733' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v322: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.51k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v323: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.63k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2995077022' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v324: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.58k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/2707917215' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v325: 33 pgs: 33 active+clean; 16 GiB data, 33 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.67k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v326: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.73k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v327: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.49k op/s 2026-02-18T03:34:09.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2298242160' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v328: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/823239863' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v329: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.60k op/s 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v330: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.70k op/s 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2186143435' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v331: 33 pgs: 33 active+clean; 16 GiB data, 34 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.60053 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3977479750' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3913969128' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:09.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/1030433777' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/252136487' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v332: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.50k op/s 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:09.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:09 trial155 ceph-mon[76401]: pgmap v333: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.64k op/s 2026-02-18T03:34:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 systemd[1]: Starting Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:34:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 podman[75272]: 2026-02-18 03:34:09.637938794 +0000 UTC m=+0.022674116 container create 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.version=25.09, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.component=ceph-nvmeof, io.spdk.git.branch=undefined, com.redhat.component=ubi9-container, io.ceph.nvmeof=, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.maintainer=Ceph Developers , io.buildah.version=1.29.0, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, version=1.6.5, vcs-type=git, io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., distribution-scope=public, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers , name=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, io.spdk.build.makeflags=, io.openshift.wants=ceph,rbd, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T03:34:09.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 podman[75272]: 2026-02-18 03:34:09.677176909 +0000 UTC m=+0.061912232 container init 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.summary=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, org.centos.version=9.0-30.el9, io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, version=1.6.5, vcs-type=git, io.ceph.component=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.ceph.git.branch=devel, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, io.ceph.nvmeof=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=, io.openshift.wants=ceph,rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, name=ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, io.spdk.version=25.09) 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 podman[75272]: 2026-02-18 03:34:09.68068321 +0000 UTC m=+0.065418522 container start 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, version=1.6.5, vcs-type=git, url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.ceph.version=1.6.5, com.redhat.component=ubi9-container, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, io.buildah.version=1.29.0, io.ceph.component=ceph-nvmeof, io.ceph.nvmeof=, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.branch=undefined, io.spdk.build.target-arch=x86-64-v2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.version=25.09, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, vendor=Red Hat, Inc.) 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 bash[75272]: 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 podman[75272]: 2026-02-18 03:34:09.629990072 +0000 UTC m=+0.014725394 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 systemd[1]: Started Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:34:09.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [gateway] 2026-02-18T03:34:09.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): port = 5500 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:34:09.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:09.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:34:09.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:34:09.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:34:10.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): force_tls = False 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:34:10.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [discovery] 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): port = 8009 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [ceph] 2026-02-18T03:34:10.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): pool = mypool 2026-02-18T03:34:10.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [mtls] 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [spdk] 2026-02-18T03:34:10.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): transports = tcp 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): 2026-02-18T03:34:10.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): [monitor] 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:34:10.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:09] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.86:5499 for group id 2026-02-18T03:34:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 systemd[1]: Starting Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:34:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 podman[76691]: 2026-02-18 03:34:10.13753409 +0000 UTC m=+0.019683479 container create ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.build.ceph-release=20.2.0, org.centos.version=9.0-30.el9, url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, io.ceph.nvmeof=, vendor=Red Hat, Inc., io.ceph.git.branch=devel, vcs-type=git, io.openshift.wants=ceph,rbd, com.redhat.component=ubi9-container, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, release=, io.spdk.git.branch=undefined, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=25.09, architecture=x86_64, io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.buildah.version=1.29.0, io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.component=ceph-nvmeof) 2026-02-18T03:34:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 podman[76691]: 2026-02-18 03:34:10.192568352 +0000 UTC m=+0.074717721 container init ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.git.branch=undefined, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.git.branch=devel, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.openshift.wants=ceph,rbd, io.ceph.version=1.6.5, io.buildah.version=1.29.0, io.spdk.version=25.09, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.ceph.nvmeof=, vendor=Red Hat, Inc., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.component=ceph-nvmeof, release=, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, architecture=x86_64, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:34:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 podman[76691]: 2026-02-18 03:34:10.195263398 +0000 UTC m=+0.077412767 container start ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, vcs-type=git, io.ceph.version=1.6.5, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, release=, com.redhat.component=ubi9-container, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=, vendor=Red Hat, Inc., architecture=x86_64, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.ceph.git.branch=devel, io.ceph.maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, build-date=2026-02-11 09:53:49 UTC, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.spdk.build.ceph-release=20.2.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.component=ceph-nvmeof, io.spdk.git.branch=undefined, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.version=25.09) 2026-02-18T03:34:10.373 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 bash[76691]: ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:34:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 podman[76691]: 2026-02-18 03:34:10.129128991 +0000 UTC m=+0.011278360 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:34:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 systemd[1]: Started Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='client.60086 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.b", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: Schedule restart daemon nvmeof.nvmeof.b 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='client.45522 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: mon.c calling monitor election 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: mon.a calling monitor election 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: monmap epoch 3 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:10.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: min_mon_release 20 (tentacle) 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: election_strategy: 1 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: fsmap 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: mgrmap e15: x(active, since 9m) 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: pgmap v334: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:34:10.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [gateway] 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): port = 5500 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:34:10.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:34:10.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:34:10.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:34:10.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): force_tls = False 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:34:10.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [discovery] 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): port = 8009 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [ceph] 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): pool = mypool 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [mtls] 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [spdk] 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): transports = tcp 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:34:10.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): [monitor] 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:34:10.742 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:10] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.155:5499 for group id 2026-02-18T03:34:10.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:34:10.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:34:10.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:10] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:34:10.749 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='client.60086 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.b", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: Schedule restart daemon nvmeof.nvmeof.b 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='client.45522 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: mon.c calling monitor election 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: mon.a calling monitor election 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: monmap epoch 3 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:34:10.750 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: min_mon_release 20 (tentacle) 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: election_strategy: 1 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: fsmap 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: mgrmap e15: x(active, since 9m) 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:34:10.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: pgmap v334: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.752 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:10 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='client.60086 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.b", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: Schedule restart daemon nvmeof.nvmeof.b 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='client.45522 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:10.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 9m) 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: pgmap v334: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:10.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:10 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.672 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.672 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.672 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4291134223' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.673 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:11.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:34:11] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:11.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.679 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:11.680 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:11.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:11.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:11.681 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:33278 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:34:11] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:11.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:11.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.719 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.720 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:11.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:11.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:11.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:11.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:11.721 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:59520 2026-02-18T03:34:11.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 217.70 2.5M 2.8M 0.0k 25.3M 27.6M 0.0k nvme12n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 222.30 2.8M 2.7M 0.0k 27.8M 26.7M 0.0k nvme16n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 226.40 2.8M 2.7M 0.0k 27.5M 26.5M 0.0k nvme20n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 215.90 2.6M 2.8M 0.0k 25.7M 27.5M 0.0k nvme24n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 229.40 2.9M 2.5M 0.0k 28.8M 25.3M 0.0k nvme28n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 234.50 2.9M 2.7M 0.0k 29.2M 26.8M 0.0k nvme32n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 220.80 2.7M 2.6M 0.0k 27.3M 26.2M 0.0k nvme36n3 2026-02-18T03:34:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 217.00 2.6M 2.6M 0.0k 26.2M 26.2M 0.0k nvme40n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.30 2.8M 2.7M 0.0k 27.7M 26.9M 0.0k nvme44n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 225.70 2.7M 2.7M 0.0k 26.8M 27.2M 0.0k nvme48n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 229.50 2.9M 2.7M 0.0k 29.2M 27.2M 0.0k nvme4n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 218.10 2.5M 2.7M 0.0k 25.5M 27.1M 0.0k nvme52n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 223.40 2.8M 2.6M 0.0k 27.6M 26.3M 0.0k nvme56n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 217.20 2.7M 2.6M 0.0k 26.6M 26.2M 0.0k nvme60n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 218.00 2.7M 2.6M 0.0k 27.1M 26.3M 0.0k nvme64n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 219.30 2.7M 2.7M 0.0k 27.1M 27.1M 0.0k nvme8n3 2026-02-18T03:34:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:11.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4291134223' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:11 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/4291134223' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:34:11.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:34:11.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:34:11.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:34:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:34:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:34:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:34:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:34:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:11] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:34:12.420 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:34:12.665 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:34:12.676 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:34:12.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:34:12.677 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:34:12.678 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-mon[73228]: pgmap v335: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.67k op/s 2026-02-18T03:34:12.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:34:12.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:34:12.678 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: INFO: Setting log level to WARNING 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.394813] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.394871] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.511185] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.545250] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.549613] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.549625] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.549627] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:34:12.679 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.675080] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:34:12.697 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:12 trial034 ceph-mon[21825]: pgmap v335: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.67k op/s 2026-02-18T03:34:12.756 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 602181, 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:34:12.757 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.758 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.759 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.760 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:34:12.761 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.762 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:34:12.763 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.764 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:34:12.765 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.766 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.767 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:34:12.768 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:34:12.769 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.770 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:34:12.771 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.772 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "num": 57 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:34:12.773 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.774 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.774 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.774 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:34:12.774 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:34:12.775 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:34:12.775 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:34:12.776 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:34:12.894 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:34:12.894 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:34:12.894 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:34:12.894 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 167195, 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:34:12.895 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.896 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.897 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:34:12.898 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.899 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.900 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.901 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.902 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.903 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.904 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.905 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.906 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.907 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: "num": 24 2026-02-18T03:34:12.908 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.909 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.909 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.909 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:34:12.909 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:34:12.910 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:34:12.910 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:34:12.911 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:34:12.933 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO discovery.py:369 (78): discovery addr: 10.20.193.86 port: 8009 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.727427] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:12.727539] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial086). 2026-02-18T03:34:12.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial086). 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO state.py:2073 (78): Initialization is over (discovery-trial086). 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:34:12.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:12.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:12 trial155 ceph-mon[76401]: pgmap v335: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 45 MiB/s wr, 3.67k op/s 2026-02-18T03:34:12.991 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:34:12.991 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:34:12.991 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:34:12.991 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 3797, 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:34:12.992 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.993 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.994 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:34:12.995 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:34:12.996 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:12.997 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.998 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:12.999 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:13.000 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:34:13.001 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:34:13.002 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:34:13.003 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:34:13.004 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:34:13.005 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:34:13.005 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:34:13.005 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:34:13.006 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:34:13.006 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:34:13.006 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:34:13.259 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:34:13.259 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.259 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:34:13.259 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.260 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:12 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:12] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.075653] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.86:0/1342578147, rc 0 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.087642] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.86:0/1342578147 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.86:0/1342578147' 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.118033] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:34:13.261 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.124603] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:34:13.262 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.124919] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:34:13.262 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.124934] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:13.262 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:13.262 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:13.263 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.301426] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.86:0/3400683522, rc 0 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.301515] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.86:0/3400683522 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.86:0/3400683522' 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.321201] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.326222] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.326258] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:13.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.472699] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.86:0/3448491164, rc 0 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.472784] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.86:0/3448491164 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.86:0/3448491164' 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.491837] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.499012] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:34:13.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.499046] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:13.781 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:34:13.781 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: Cluster is now healthy 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3891160627' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/4242845200' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/2950761441' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/4171158848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/2413234152' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:34:13.782 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {auth=38,config=2,health=13,kv=47} crc {auth=2701916190,config=3825401348,health=1181117202,kv=3049592650}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2346162662}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {kv=80,logm=20} crc {kv=3154269295,logm=3116625216}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2206462357}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496001670}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2782869658}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1561393601}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2289938486}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=551360043}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554085253}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2325396048}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866479633}) 2026-02-18T03:34:13.783 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738582004}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029017620}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3637766261}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1034543485}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3806452719}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3845995559}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017338486}) 2026-02-18T03:34:13.784 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: INFO: Setting log level to WARNING 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.498105] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.498165] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.614945] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.648034] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.648046] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.648058] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.648061] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:34:13.785 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:34:13.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:34:13.786 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.779861] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1125838403}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3112458142}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=538119817}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666998523}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225412211}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1468142259}) 2026-02-18T03:34:13.786 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2778139962}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472320988}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1452902740}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1794307363}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {logm=21,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=17,mon_config_key=39} crc {logm=3292199612,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3112560357,mon_config_key=4287878019}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1176586680}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=74,monmap=5,nvmeofgw=21} crc {mon_config_key=3786745792,monmap=1407976167,nvmeofgw=3430569519}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3003102072}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=4073664912,osd_metadata=2727074769,osd_pg_creating=3370328487,osd_snap=3842414688,osdmap=3455824481}) 2026-02-18T03:34:13.787 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-mon[76401]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=3993924081}) 2026-02-18T03:34:13.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.656770] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.86:0/3120749929, rc 0 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.656869] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.86:0/3120749929 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.86:0/3120749929' 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.675634] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.687131] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.687165] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:13.800 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: Cluster is now healthy 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3891160627' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/4242845200' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2950761441' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.801 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/4171158848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2413234152' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {auth=38,config=2,health=13,kv=47} crc {auth=2701916190,config=3825401348,health=1181117202,kv=3049592650}) 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2346162662}) 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {kv=80,logm=20} crc {kv=3154269295,logm=3116625216}) 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2206462357}) 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496001670}) 2026-02-18T03:34:13.802 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2782869658}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1561393601}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2289938486}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=551360043}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554085253}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2325396048}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866479633}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738582004}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029017620}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3637766261}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1034543485}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3806452719}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3845995559}) 2026-02-18T03:34:13.803 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017338486}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1125838403}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3112458142}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=538119817}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666998523}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225412211}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1468142259}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2778139962}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472320988}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1452902740}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1794307363}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=21,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=17,mon_config_key=39} crc {logm=3292199612,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3112560357,mon_config_key=4287878019}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1176586680}) 2026-02-18T03:34:13.804 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=74,monmap=5,nvmeofgw=21} crc {mon_config_key=3786745792,monmap=1407976167,nvmeofgw=3430569519}) 2026-02-18T03:34:13.805 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3003102072}) 2026-02-18T03:34:13.805 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=4073664912,osd_metadata=2727074769,osd_pg_creating=3370328487,osd_snap=3842414688,osdmap=3455824481}) 2026-02-18T03:34:13.805 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=3993924081}) 2026-02-18T03:34:14.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:34:14.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: Cluster is now healthy 2026-02-18T03:34:14.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3891160627' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4242845200' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2950761441' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4171158848' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2413234152' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:34:14.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {auth=38,config=2,health=13,kv=47} crc {auth=2701916190,config=3825401348,health=1181117202,kv=3049592650}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2346162662}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=80,logm=20} crc {kv=3154269295,logm=3116625216}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2206462357}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496001670}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2782869658}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1561393601}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2289938486}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=551360043}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554085253}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2325396048}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866479633}) 2026-02-18T03:34:14.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738582004}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029017620}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3637766261}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1034543485}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3806452719}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3845995559}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017338486}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1125838403}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3112458142}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=538119817}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666998523}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225412211}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1468142259}) 2026-02-18T03:34:14.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2778139962}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472320988}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1452902740}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1794307363}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=21,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=17,mon_config_key=39} crc {logm=3292199612,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3112560357,mon_config_key=4287878019}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1176586680}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=74,monmap=5,nvmeofgw=21} crc {mon_config_key=3786745792,monmap=1407976167,nvmeofgw=3430569519}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3003102072}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=18,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {nvmeofgw=4073664912,osd_metadata=2727074769,osd_pg_creating=3370328487,osd_snap=3842414688,osdmap=3455824481}) 2026-02-18T03:34:14.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:13 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=3993924081}) 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:34:14.038 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO discovery.py:369 (81): discovery addr: 10.20.193.155 port: 8009 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.827934] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:13.827991] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial155). 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial155). 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO state.py:2073 (81): Initialization is over (discovery-trial155). 2026-02-18T03:34:14.039 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:13] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.041 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:34:14.042 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.841343] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.86:0/1152111536, rc 0 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.841454] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.86:0/1152111536 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.86:0/1152111536' 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.866652] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.871311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:13.871347] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:13 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:13] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.073 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.019559] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.86:0/1083176373, rc 0 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.020632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.86:0/1083176373 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.86:0/1083176373' 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.046640] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.071847] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:34:14.074 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.071918] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:14.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:34:14.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:34:14.343 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:34:14.344 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.169099] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.155:0/346294982, rc 0 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.169199] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.155:0/346294982 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.155:0/346294982' 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.200011] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.204815] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.205210] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.205234] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:14.345 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.346 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.216588] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.86:0/1812419774, rc 0 2026-02-18T03:34:14.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.216662] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.86:0/1812419774 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.86:0/1812419774' 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.240749] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.245834] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.245864] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.615 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/1413328502' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:14.615 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/2539109310' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:14.615 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-mon[76401]: pgmap v336: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.70k op/s 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.385823] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.155:0/374661980, rc 0 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.389394] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.155:0/374661980 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.155:0/374661980' 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.410037] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.416896] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.417007] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:14.616 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.583653] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.155:0/2360684541, rc 0 2026-02-18T03:34:14.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.587036] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.155:0/2360684541 2026-02-18T03:34:14.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.155:0/2360684541' 2026-02-18T03:34:14.617 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.614064] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1413328502' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:14.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2539109310' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:14.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-mon[73228]: pgmap v336: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.70k op/s 2026-02-18T03:34:14.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.446604] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.86:0/470184220, rc 0 2026-02-18T03:34:14.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.447632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.86:0/470184220 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.86:0/470184220' 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.475436] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.479961] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.479991] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.640832] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.86:0/593712524, rc 0 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.640981] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.86:0/593712524 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.86:0/593712524' 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.673985] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.678824] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.678863] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.847178] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.86:0/1008975590, rc 0 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.847261] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.86:0/1008975590 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.86:0/1008975590' 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.864871] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.877811] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:14.877852] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.632336] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.632392] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.814935] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.155:0/2596807736, rc 0 2026-02-18T03:34:14.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.816038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.155:0/2596807736 2026-02-18T03:34:14.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.155:0/2596807736' 2026-02-18T03:34:14.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.851470] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:14.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:34:14.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.856136] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:34:14.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:14.856180] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:15.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1413328502' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:34:15.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2539109310' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:15.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:14 trial034 ceph-mon[21825]: pgmap v336: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.70k op/s 2026-02-18T03:34:15.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:14] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.251 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.021285] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.155:0/3460230393, rc 0 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.022041] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.155:0/3460230393 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.155:0/3460230393' 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.048059] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.054271] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.054321] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.252 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.250440] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.155:0/1364177465, rc 0 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.011267] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.86:0/1927473479, rc 0 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.011569] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.86:0/1927473479 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.86:0/1927473479' 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.038639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.070978] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.071035] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:15.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.251149] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.86:0/3027002676, rc 0 2026-02-18T03:34:15.504 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.254636] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.86:0/3027002676 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.86:0/3027002676' 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.274395] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.279731] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.279762] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.505 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.503818] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.86:0/1136438701, rc 0 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.251068] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.155:0/1364177465 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.155:0/1364177465' 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.275174] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.280350] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.280389] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:15.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.455752] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.155:0/452695244, rc 0 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.455843] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.155:0/452695244 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.155:0/452695244' 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.479690] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.484406] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.484441] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.758 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.504384] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.86:0/1136438701 2026-02-18T03:34:15.758 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.86:0/1136438701' 2026-02-18T03:34:15.758 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.528018] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.758 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:34:15.758 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.532745] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.532777] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.734074] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.86:0/1127543359, rc 0 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.735635] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.86:0/1127543359 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.86:0/1127543359' 2026-02-18T03:34:15.759 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.757369] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.694560] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.155:0/1840495268, rc 0 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.694677] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.155:0/1840495268 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.155:0/1840495268' 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.716921] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.729773] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.729897] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.911872] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.155:0/1428297868, rc 0 2026-02-18T03:34:16.106 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.764242] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.764279] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.926390] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.86:0/2143969285, rc 0 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.926631] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.86:0/2143969285 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.86:0/2143969285' 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.954654] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:34:16.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.972052] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:34:16.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:15.972098] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:16.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.912030] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.155:0/1428297868 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.155:0/1428297868' 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.934036] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:15] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.949655] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:15 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:15.949722] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:16.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.097382] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.155:0/761387407, rc 0 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.098044] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.155:0/761387407 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.155:0/761387407' 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.132998] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.146298] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:34:16.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.146357] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.137032] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.86:0/422363275, rc 0 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.137106] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.86:0/422363275 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.86:0/422363275' 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.152152] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.157125] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.157154] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.310073] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.86:0/3416537172, rc 0 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.310730] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.86:0/3416537172 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.86:0/3416537172' 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.330645] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.339339] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:34:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.339377] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:16.608 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-mon[76401]: pgmap v337: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.51k op/s 2026-02-18T03:34:16.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.346792] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.155:0/2728818522, rc 0 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.346906] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.155:0/2728818522 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.155:0/2728818522' 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.371926] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.381572] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.381613] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:16.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.834 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-mon[73228]: pgmap v337: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.51k op/s 2026-02-18T03:34:16.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.504913] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.86:0/1625422590, rc 0 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.505545] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.86:0/1625422590 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.86:0/1625422590' 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.524082] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.528810] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.528846] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.669492] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.86:0/2604860948, rc 0 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.669589] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.86:0/2604860948 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.86:0/2604860948' 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.693354] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.699033] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.699069] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.607363] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.155:0/4144115844, rc 0 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.608047] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.155:0/4144115844 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.155:0/4144115844' 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.640393] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.653162] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.653273] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.826197] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.155:0/2013979493, rc 0 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.826358] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.155:0/2013979493 2026-02-18T03:34:16.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.155:0/2013979493' 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.849220] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.854119] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:16.854150] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:16.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:16 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:16] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:16 trial034 ceph-mon[21825]: pgmap v337: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.51k op/s 2026-02-18T03:34:17.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.879313] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.86:0/2562609160, rc 0 2026-02-18T03:34:17.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.880636] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.86:0/2562609160 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.86:0/2562609160' 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.908636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:16] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.921840] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:16.921879] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.069628] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.86:0/1241165515, rc 0 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.069710] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.86:0/1241165515 2026-02-18T03:34:17.092 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.86:0/1241165515' 2026-02-18T03:34:17.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.090635] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.018792] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.155:0/2154594666, rc 0 2026-02-18T03:34:17.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.022169] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.155:0/2154594666 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.155:0/2154594666' 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.041053] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.057391] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.057516] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:34:17.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.098605] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:34:17.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.098642] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:17.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.259919] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.86:0/424034837, rc 0 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.260625] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.86:0/424034837 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.86:0/424034837' 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.286655] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.307326] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:34:17.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.307376] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.234187] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.155:0/3009675332, rc 0 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.242058] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.155:0/3009675332 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.155:0/3009675332' 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.263823] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:34:17.489 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.283317] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.283435] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.472135] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.155:0/117621321, rc 0 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.472222] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.155:0/117621321 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.155:0/117621321' 2026-02-18T03:34:17.490 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.488046] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.689 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.689 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.689 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.478763] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.86:0/4044665330, rc 0 2026-02-18T03:34:17.689 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.478858] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.86:0/4044665330 2026-02-18T03:34:17.689 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.86:0/4044665330' 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.493682] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.510346] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.510391] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.690 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.688315] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.86:0/467477105, rc 0 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.496091] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.496152] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.700766] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.155:0/4068462971, rc 0 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.701040] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.155:0/4068462971 2026-02-18T03:34:17.740 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.155:0/4068462971' 2026-02-18T03:34:17.741 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.739087] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:17.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:34:17.997 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.743799] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.743844] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.971975] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.155:0/170182675, rc 0 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.972064] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.155:0/170182675 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.155:0/170182675' 2026-02-18T03:34:17.998 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:17.996436] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.688649] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.86:0/467477105 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.86:0/467477105' 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.708008] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.718962] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:34:18.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.718998] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.881028] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.86:0/481156895, rc 0 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.882322] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.86:0/481156895 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.86:0/481156895' 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.917664] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.933526] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:34:18.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:17 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:17.933573] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:18.289 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.289 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.289 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.070783] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.86:0/3693802724, rc 0 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.070911] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.86:0/3693802724 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.86:0/3693802724' 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.087041] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.095735] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.095771] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.244708] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.86:0/529668536, rc 0 2026-02-18T03:34:18.290 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.245632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.86:0/529668536 2026-02-18T03:34:18.291 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.86:0/529668536' 2026-02-18T03:34:18.291 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.279653] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.291 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:34:18.291 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.288298] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:34:18.291 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.288345] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:18.359 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:17] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:34:18.359 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.031011] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:34:18.359 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.031086] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:18.359 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.192892] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.155:0/3718116100, rc 0 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.193027] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.155:0/3718116100 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.155:0/3718116100' 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.227535] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.235371] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:34:18.360 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.235420] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:18.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.469505] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.86:0/1023402603, rc 0 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.469599] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.86:0/1023402603 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.86:0/1023402603' 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.495634] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.526651] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:34:18.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.526705] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:18.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3411913045' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:18.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-mon[76401]: pgmap v338: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.77k op/s 2026-02-18T03:34:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.406218] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.155:0/1118455778, rc 0 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.407769] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.155:0/1118455778 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.155:0/1118455778' 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.421052] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.426432] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.426501] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.573185] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.155:0/4028404596, rc 0 2026-02-18T03:34:18.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.574043] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.155:0/4028404596 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.155:0/4028404596' 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.594935] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.605338] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.605449] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.832 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3411913045' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:18.832 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-mon[73228]: pgmap v338: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.77k op/s 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.691137] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.86:0/2520074351, rc 0 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.691643] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.86:0/2520074351 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.86:0/2520074351' 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.709361] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:34:18.833 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.724358] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:34:18.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.724402] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:18.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.834 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:18.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.760736] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.155:0/1594553368, rc 0 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.760888] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.155:0/1594553368 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.155:0/1594553368' 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.782053] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.824006] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.824079] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3411913045' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:19.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:18 trial034 ceph-mon[21825]: pgmap v338: 33 pgs: 33 active+clean; 16 GiB data, 35 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.77k op/s 2026-02-18T03:34:19.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.866268] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.86:0/904086764, rc 0 2026-02-18T03:34:19.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.866354] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.86:0/904086764 2026-02-18T03:34:19.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.86:0/904086764' 2026-02-18T03:34:19.090 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.882365] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:18] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.887162] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:18 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:18.887197] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.063712] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.86:0/1999411332, rc 0 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.064634] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.86:0/1999411332 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.86:0/1999411332' 2026-02-18T03:34:19.091 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.089439] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.994115] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.155:0/3651239545, rc 0 2026-02-18T03:34:19.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:18.997326] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.155:0/3651239545 2026-02-18T03:34:19.265 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:18] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.155:0/3651239545' 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.029052] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.059015] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.059084] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.266 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.264427] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.155:0/770516797, rc 0 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.109250] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.109305] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.289972] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.86:0/2175060118, rc 0 2026-02-18T03:34:19.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.298003] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.86:0/2175060118 2026-02-18T03:34:19.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.86:0/2175060118' 2026-02-18T03:34:19.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.323694] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:34:19.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.342287] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:34:19.344 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.342339] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:19.538 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.266036] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.155:0/770516797 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.155:0/770516797' 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.317687] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.331311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.331363] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.508419] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.155:0/1200066000, rc 0 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.509041] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.155:0/1200066000 2026-02-18T03:34:19.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.155:0/1200066000' 2026-02-18T03:34:19.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.537676] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.490633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.499805] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.499843] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:19.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.644646] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:34:19.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.653887] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.653933] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.796505] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.801169] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:34:19.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.801203] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:19.875 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:34:19.875 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.542347] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.542391] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.691596] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.155:0/3939725117, rc 0 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.692038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.155:0/3939725117 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.155:0/3939725117' 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.715451] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.723392] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:34:19.876 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.723435] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:19.877 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:19.877 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.926234] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.155:0/1482349451, rc 0 2026-02-18T03:34:20.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.927051] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.155:0/1482349451 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.155:0/1482349451' 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.959052] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.982009] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:19.982076] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.949153] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.274 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:19] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.954453] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:19.954496] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.112652] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.127864] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.127910] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.275 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.175831] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.155:0/3062080300, rc 0 2026-02-18T03:34:20.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.176001] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.155:0/3062080300 2026-02-18T03:34:20.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.155:0/3062080300' 2026-02-18T03:34:20.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.200893] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.206884] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.206957] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.424434] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.155:0/2695675874, rc 0 2026-02-18T03:34:20.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.324925] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:34:20.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.330318] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:34:20.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.330351] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:20.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.676 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3750402232' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:20.676 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-mon[76401]: pgmap v339: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.82k op/s 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.425049] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.155:0/2695675874 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.155:0/2695675874' 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.440472] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.445333] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.445391] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.630316] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.155:0/3097937364, rc 0 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.642051] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.155:0/3097937364 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.155:0/3097937364' 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.666649] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.675483] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:34:20.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.675540] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:20.791 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3750402232' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:20.791 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-mon[73228]: pgmap v339: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.82k op/s 2026-02-18T03:34:20.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.537639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:34:20.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.548450] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:34:20.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.548489] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:20.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.786589] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:34:20.805 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3750402232' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:20.805 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-mon[21825]: pgmap v339: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.82k op/s 2026-02-18T03:34:20.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:34:20] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:20.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:20.808 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.809 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.810 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.811 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:20.812 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: OPTIMIZED 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:33366 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.636464] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000208 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.652484] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000228 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.668472] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000247 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.684411] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000192 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.700474] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000244 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.716450] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000224 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.732423] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000178 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.748408] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000190 seconds 2026-02-18T03:34:20.813 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.764442] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000229 seconds 2026-02-18T03:34:20.814 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.780397] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000181 seconds 2026-02-18T03:34:20.814 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.804495] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000276 seconds 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:34:20] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:20.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:20.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:20.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: OPTIMIZED 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:45744 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.639115] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000151 seconds 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.655165] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000232 seconds 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.671112] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000187 seconds 2026-02-18T03:34:20.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.687124] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000202 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.703142] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000222 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.719093] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000172 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.735131] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000209 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.751123] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000202 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.767196] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000271 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.783079] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000154 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.799192] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000266 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.823134] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000202 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.839123] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000194 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.855136] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000207 seconds 2026-02-18T03:34:20.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [2026-02-18 03:34:20.871124] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000191 seconds 2026-02-18T03:34:20.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:20.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:20.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.853931] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.155:0/2190722079, rc 0 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.866065] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.155:0/2190722079 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.155:0/2190722079' 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.890736] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.900368] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:34:20.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:20.900425] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:21.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.795087] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:34:21.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.795124] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:21.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.983655] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:20] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:34:21.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.989804] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:34:21.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:20 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:20.989845] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:21.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.105 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.820409] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000196 seconds 2026-02-18T03:34:21.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.836402] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000183 seconds 2026-02-18T03:34:21.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.852385] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000179 seconds 2026-02-18T03:34:21.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:20 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [2026-02-18 03:34:20.868457] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000213 seconds 2026-02-18T03:34:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.084981] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.155:0/1770217511, rc 0 2026-02-18T03:34:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.091045] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.155:0/1770217511 2026-02-18T03:34:21.311 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.155:0/1770217511' 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.113846] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.118596] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.118636] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.312 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.310038] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.147442] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.151940] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.151968] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.310655] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.318728] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:34:21.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.318776] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:34:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.315502] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:34:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.315546] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:21.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.486358] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.500828] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.500892] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.3M 2.5M 0.0k 22.8M 24.9M 0.0k nvme12n3 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 195.30 2.3M 2.4M 0.0k 23.2M 23.9M 0.0k nvme16n3 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.5M 2.4M 0.0k 25.3M 23.9M 0.0k nvme20n3 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 202.90 2.4M 2.4M 0.0k 24.2M 23.9M 0.0k nvme24n3 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.4M 2.3M 0.0k 24.0M 22.8M 0.0k nvme28n3 2026-02-18T03:34:21.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.3M 2.4M 0.0k 23.2M 24.0M 0.0k nvme32n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.3M 2.4M 0.0k 23.3M 23.6M 0.0k nvme36n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.3M 2.3M 0.0k 23.4M 22.5M 0.0k nvme40n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.3M 2.3M 0.0k 23.1M 22.6M 0.0k nvme44n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.3M 2.1M 0.0k 23.2M 21.3M 0.0k nvme48n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.2M 2.3M 0.0k 21.7M 23.1M 0.0k nvme4n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.90 2.4M 2.3M 0.0k 24.4M 22.8M 0.0k nvme52n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.00 2.3M 2.3M 0.0k 23.0M 23.3M 0.0k nvme56n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 189.80 2.2M 2.2M 0.0k 21.6M 22.0M 0.0k nvme60n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 190.20 2.2M 2.3M 0.0k 21.8M 22.5M 0.0k nvme64n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 2.3M 2.3M 0.0k 23.3M 23.0M 0.0k nvme8n3 2026-02-18T03:34:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:21.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.488553] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.493697] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.493731] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.645633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.650252] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.650283] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.687063] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.694039] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.694086] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.860056] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:21.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:34:21.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.872997] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:34:21.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:21.873055] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:22.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.805588] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.118 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.810116] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.810148] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.983643] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:21] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.995203] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:21.995252] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.119 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.077636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.082334] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:34:22.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.082375] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:22.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.276866] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.170385] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:34:22.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.175420] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:34:22.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.175457] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:22.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.335847] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:34:22.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.357573] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:34:22.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.357636] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.286722] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.286776] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.632 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.489330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:34:22.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.504718] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:34:22.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.504785] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:22.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.633 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.820 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-mon[73228]: pgmap v340: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 4.04k op/s 2026-02-18T03:34:22.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.820 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.524626] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.529089] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.529121] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.704589] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.709072] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.709105] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.821 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:22.916 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-mon[76401]: pgmap v340: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 4.04k op/s 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.698795] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.703373] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.703404] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:22.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:22 trial034 ceph-mon[21825]: pgmap v340: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 4.04k op/s 2026-02-18T03:34:23.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.890661] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:34:23.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.928602] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:34:23.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:22 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:22.928666] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:23.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.100636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.915567] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:22] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.927559] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:22.927615] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.139069] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.143744] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:34:23.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.143787] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.105159] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.105199] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.282553] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:34:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.300825] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:34:23.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.300880] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.326052] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.539 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:34:23.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.334015] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:34:23.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.334054] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.538069] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.471306] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.481662] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.481710] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.659 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:34:23.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.552428] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:34:23.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.552486] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.862 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.740058] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.747285] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.747338] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.863 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.658043] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:34:23.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.662748] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.662779] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.847650] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.861290] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:23.861339] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:23.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.940195] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:23] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.950499] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:23.950553] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.170777] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.321 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.049760] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.054498] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.054532] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.203693] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.208408] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:34:24.322 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.208443] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:24.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.323 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.186247] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.186316] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.398961] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.403509] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:34:24.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.403546] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:24.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.367640] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.387115] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.387159] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.573 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.571893] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.817 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-mon[76401]: pgmap v341: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 4.30k op/s 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.608787] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.614063] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.614105] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.818 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.819 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.800055] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.819 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:34:24.819 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.816481] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:34:24.819 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.816602] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:24.854 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-mon[73228]: pgmap v341: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 4.30k op/s 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.576403] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.576431] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.743218] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:24.855 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:34:24.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.749288] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:34:24.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.749325] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:24.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:24.856 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:24 trial034 ceph-mon[21825]: pgmap v341: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 4.30k op/s 2026-02-18T03:34:25.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.902642] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:34:25.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.912693] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:34:25.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:24.912733] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:25.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:25.106331] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:24.997054] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:24] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.002087] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.002133] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:25.122 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.123 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:25.110948] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:25.110983] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:25.238779] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.86 port 4420 *** 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.366 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.367 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.368 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.369 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.184056] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.192369] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.192426] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.362156] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:34:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.366774] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:34:25.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.366816] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:25.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:34:25.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:25] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:34:25.765 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/866989884' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.552998] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.570212] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.570282] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.764445] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/866989884' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:26.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/866989884' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:26.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.769028] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.769073] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.951576] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:25] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.969351] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:25.969411] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.186436] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.191202] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.191247] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.349257] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:34:26.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.353905] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:34:26.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.353970] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:26.864 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/897626456' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:26.864 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-mon[76401]: pgmap v342: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.26k op/s 2026-02-18T03:34:26.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:26.864 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.531340] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.536583] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.536620] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.719062] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.725976] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.726030] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:26.865 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/897626456' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:27.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:26 trial034 ceph-mon[21825]: pgmap v342: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.26k op/s 2026-02-18T03:34:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:26 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/897626456' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:27.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:26 trial086 ceph-mon[73228]: pgmap v342: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.26k op/s 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.922873] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:26] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.929314] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:26.929352] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.111054] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:27.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:34:27.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.131076] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:34:27.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.131145] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.310046] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.344387] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.344513] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:34:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:34:27.721 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/1324865192' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.515574] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.520245] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.520283] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:27.660119] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.155 port 4420 *** 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:34:27.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:27] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:34:28.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1324865192' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:34:27] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:34:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:34:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:34:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:34:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:39820 2026-02-18T03:34:28.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:27 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1324865192' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:34:28] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:28.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:28.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:34:28.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:34:28.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:39072 2026-02-18T03:34:28.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:28 trial155 ceph-mon[76401]: pgmap v343: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 4.38k op/s 2026-02-18T03:34:28.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:28 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/2847750275' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:29.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:28 trial034 ceph-mon[21825]: pgmap v343: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 4.38k op/s 2026-02-18T03:34:29.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2847750275' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:28 trial086 ceph-mon[73228]: pgmap v343: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 4.38k op/s 2026-02-18T03:34:29.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2847750275' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:30 trial155 ceph-mon[76401]: pgmap v344: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.31k op/s 2026-02-18T03:34:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:30 trial034 ceph-mon[21825]: pgmap v344: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.31k op/s 2026-02-18T03:34:30.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-mon[73228]: pgmap v344: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 4.31k op/s 2026-02-18T03:34:30.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:34:30] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:30.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:30.626 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.627 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.628 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.629 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: states { 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: grp_id: 2 2026-02-18T03:34:30.630 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: state: OPTIMIZED 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: } 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: ], , client address: IPv4 10.20.193.86:50500 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.211146] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000243 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.231397] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000292 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.251084] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000338 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.276177] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000318 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.292069] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000258 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.308043] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000226 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.332068] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000234 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.348023] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000204 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.363989] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000166 seconds 2026-02-18T03:34:30.631 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.380080] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000268 seconds 2026-02-18T03:34:30.632 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.395989] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000181 seconds 2026-02-18T03:34:30.632 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.412036] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000218 seconds 2026-02-18T03:34:30.632 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.428024] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000202 seconds 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.70 2.6M 2.4M 0.0k 26.5M 23.6M 0.0k nvme12n3 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 2.1M 2.3M 0.0k 21.2M 22.7M 0.0k nvme16n3 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.2M 2.3M 0.0k 22.4M 22.7M 0.0k nvme20n3 2026-02-18T03:34:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 198.90 2.3M 2.3M 0.0k 22.9M 23.0M 0.0k nvme24n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 2.3M 2.3M 0.0k 23.5M 23.0M 0.0k nvme28n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.00 2.4M 2.2M 0.0k 24.0M 22.1M 0.0k nvme32n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.3M 2.2M 0.0k 22.9M 22.2M 0.0k nvme36n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 2.2M 2.2M 0.0k 22.3M 21.8M 0.0k nvme40n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 2.3M 2.3M 0.0k 23.4M 23.2M 0.0k nvme44n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 2.4M 2.2M 0.0k 24.2M 22.4M 0.0k nvme48n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.40 2.5M 2.2M 0.0k 24.7M 21.8M 0.0k nvme4n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.3M 2.4M 0.0k 23.4M 23.9M 0.0k nvme52n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.1M 2.2M 0.0k 21.1M 22.4M 0.0k nvme56n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.30 2.5M 2.2M 0.0k 24.8M 22.2M 0.0k nvme60n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.4M 2.2M 0.0k 24.1M 22.2M 0.0k nvme64n3 2026-02-18T03:34:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.3M 2.2M 0.0k 22.8M 22.2M 0.0k nvme8n3 2026-02-18T03:34:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:31.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:34:31] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:34:31.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:34:31.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 3 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:39544 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.536478] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000270 seconds 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.552554] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000325 seconds 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.568433] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000247 seconds 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.583400] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.002874 seconds 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.592481] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000293 seconds 2026-02-18T03:34:31.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.608532] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000310 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.620511] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000294 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.632559] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000333 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.649310] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.001090 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.668748] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000360 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.681482] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.001248 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.696523] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000301 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.712557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000341 seconds 2026-02-18T03:34:31.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.736541] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000315 seconds 2026-02-18T03:34:32.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:32 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2881196507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:32.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:32 trial086 ceph-mon[73228]: pgmap v345: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 4.33k op/s 2026-02-18T03:34:32.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:32 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2881196507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:32.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:32 trial155 ceph-mon[76401]: pgmap v345: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 4.33k op/s 2026-02-18T03:34:33.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2881196507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:33.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:32 trial034 ceph-mon[21825]: pgmap v345: 33 pgs: 33 active+clean; 16 GiB data, 36 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 4.33k op/s 2026-02-18T03:34:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:33 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/787909152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:33.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:33 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/787909152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:34.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/787909152' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:34.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/526428421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:34.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:34 trial086 ceph-mon[73228]: pgmap v346: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 4.21k op/s 2026-02-18T03:34:34.878 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:34 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/526428421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:34.878 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:34 trial155 ceph-mon[76401]: pgmap v346: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 4.21k op/s 2026-02-18T03:34:35.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/526428421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:35.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:34 trial034 ceph-mon[21825]: pgmap v346: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 4.21k op/s 2026-02-18T03:34:35.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1911268323' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:35.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:35 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/1911268323' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:36.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1911268323' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:36.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:36 trial086 ceph-mon[73228]: pgmap v347: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 35 MiB/s wr, 3.75k op/s 2026-02-18T03:34:36.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:36 trial155 ceph-mon[76401]: pgmap v347: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 35 MiB/s wr, 3.75k op/s 2026-02-18T03:34:37.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:36 trial034 ceph-mon[21825]: pgmap v347: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 35 MiB/s wr, 3.75k op/s 2026-02-18T03:34:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:38 trial155 ceph-mon[76401]: pgmap v348: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:34:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:38 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/1629140065' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:38 trial034 ceph-mon[21825]: pgmap v348: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:34:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1629140065' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:38 trial086 ceph-mon[73228]: pgmap v348: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:34:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:38 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1629140065' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:40.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:39 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/2095742697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:40.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2095742697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:39 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2095742697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:40 trial155 ceph-mon[76401]: pgmap v349: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.54k op/s 2026-02-18T03:34:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:40 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/1086818554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:40 trial034 ceph-mon[21825]: pgmap v349: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.54k op/s 2026-02-18T03:34:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:40 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1086818554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:40 trial086 ceph-mon[73228]: pgmap v349: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 36 MiB/s wr, 3.54k op/s 2026-02-18T03:34:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:40 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1086818554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:41.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 2.3M 2.3M 0.0k 23.3M 22.6M 0.0k nvme12n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.2M 2.2M 0.0k 21.8M 22.3M 0.0k nvme16n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.10 2.2M 2.2M 0.0k 22.3M 22.2M 0.0k nvme20n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 2.2M 2.4M 0.0k 21.6M 24.1M 0.0k nvme24n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 2.3M 2.2M 0.0k 23.1M 22.1M 0.0k nvme28n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 215.10 2.3M 2.3M 0.0k 23.3M 23.1M 0.0k nvme32n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.3M 2.2M 0.0k 22.9M 21.7M 0.0k nvme36n3 2026-02-18T03:34:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 212.90 2.3M 2.4M 0.0k 23.4M 23.8M 0.0k nvme40n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 216.40 2.6M 2.3M 0.0k 26.0M 23.4M 0.0k nvme44n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 2.2M 2.4M 0.0k 22.4M 23.6M 0.0k nvme48n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.3M 2.3M 0.0k 22.8M 22.9M 0.0k nvme4n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.20 2.3M 2.4M 0.0k 22.9M 23.7M 0.0k nvme52n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 213.60 2.5M 2.3M 0.0k 24.5M 23.2M 0.0k nvme56n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.30 2.3M 2.4M 0.0k 22.7M 23.9M 0.0k nvme60n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.70 2.3M 2.3M 0.0k 22.8M 22.9M 0.0k nvme64n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 210.40 2.4M 2.3M 0.0k 24.0M 23.3M 0.0k nvme8n3 2026-02-18T03:34:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:42 trial155 ceph-mon[76401]: pgmap v350: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.50k op/s 2026-02-18T03:34:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:42 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/2580966562' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:42 trial034 ceph-mon[21825]: pgmap v350: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.50k op/s 2026-02-18T03:34:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2580966562' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:42 trial086 ceph-mon[73228]: pgmap v350: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.50k op/s 2026-02-18T03:34:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2580966562' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:44 trial155 ceph-mon[76401]: pgmap v351: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.47k op/s 2026-02-18T03:34:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:44 trial034 ceph-mon[21825]: pgmap v351: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.47k op/s 2026-02-18T03:34:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:44 trial086 ceph-mon[73228]: pgmap v351: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.47k op/s 2026-02-18T03:34:46.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:45 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3451715539' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3451715539' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:45 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3451715539' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:46 trial155 ceph-mon[76401]: pgmap v352: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.24k op/s 2026-02-18T03:34:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:46 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/1070661759' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:46 trial034 ceph-mon[21825]: pgmap v352: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.24k op/s 2026-02-18T03:34:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1070661759' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:46 trial086 ceph-mon[73228]: pgmap v352: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.24k op/s 2026-02-18T03:34:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:46 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1070661759' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:48.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:47 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/1990756576' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:48.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:47 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1990756576' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:47 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1990756576' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:48 trial155 ceph-mon[76401]: pgmap v353: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.37k op/s 2026-02-18T03:34:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:48 trial034 ceph-mon[21825]: pgmap v353: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.37k op/s 2026-02-18T03:34:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:48 trial086 ceph-mon[73228]: pgmap v353: 33 pgs: 33 active+clean; 16 GiB data, 37 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.37k op/s 2026-02-18T03:34:50.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3450309481' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:49 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3450309481' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:49 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/3450309481' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:50 trial034 ceph-mon[21825]: pgmap v354: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.33k op/s 2026-02-18T03:34:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:50 trial086 ceph-mon[73228]: pgmap v354: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.33k op/s 2026-02-18T03:34:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:50 trial155 ceph-mon[76401]: pgmap v354: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.33k op/s 2026-02-18T03:34:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:51.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.60 2.3M 2.2M 0.0k 23.2M 22.5M 0.0k nvme12n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 205.60 2.3M 2.4M 0.0k 22.6M 23.6M 0.0k nvme16n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.60 2.2M 2.2M 0.0k 21.8M 22.4M 0.0k nvme20n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 2.3M 2.1M 0.0k 23.2M 21.5M 0.0k nvme24n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.0M 2.3M 0.0k 20.1M 22.6M 0.0k nvme28n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 218.60 2.4M 2.3M 0.0k 24.0M 23.1M 0.0k nvme32n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 213.00 2.3M 2.2M 0.0k 23.5M 21.9M 0.0k nvme36n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 216.10 2.3M 2.3M 0.0k 23.3M 23.0M 0.0k nvme40n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 209.00 2.2M 2.3M 0.0k 21.7M 22.5M 0.0k nvme44n3 2026-02-18T03:34:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.0M 2.2M 0.0k 19.8M 21.7M 0.0k nvme48n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 211.80 2.3M 2.3M 0.0k 23.3M 22.8M 0.0k nvme4n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.20 2.2M 2.3M 0.0k 22.3M 23.3M 0.0k nvme52n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.2M 2.1M 0.0k 22.0M 21.2M 0.0k nvme56n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 214.20 2.4M 2.3M 0.0k 23.9M 22.7M 0.0k nvme60n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 2.2M 2.4M 0.0k 21.7M 23.8M 0.0k nvme64n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.30 2.1M 2.3M 0.0k 21.2M 22.6M 0.0k nvme8n3 2026-02-18T03:34:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:34:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:52 trial034 ceph-mon[21825]: pgmap v355: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.43k op/s 2026-02-18T03:34:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2880116865' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:52 trial086 ceph-mon[73228]: pgmap v355: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.43k op/s 2026-02-18T03:34:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:52 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2880116865' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:52 trial155 ceph-mon[76401]: pgmap v355: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.43k op/s 2026-02-18T03:34:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:52 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2880116865' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:54.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/578718596' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/578718596' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:53 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/578718596' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:55.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:54 trial034 ceph-mon[21825]: pgmap v356: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.47k op/s 2026-02-18T03:34:55.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:54 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3276074032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:54 trial086 ceph-mon[73228]: pgmap v356: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.47k op/s 2026-02-18T03:34:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:54 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3276074032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:54 trial155 ceph-mon[76401]: pgmap v356: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.47k op/s 2026-02-18T03:34:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:54 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3276074032' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:56 trial034 ceph-mon[21825]: pgmap v357: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.25k op/s 2026-02-18T03:34:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2162819704' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:56 trial086 ceph-mon[73228]: pgmap v357: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.25k op/s 2026-02-18T03:34:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:56 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2162819704' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:56 trial155 ceph-mon[76401]: pgmap v357: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.25k op/s 2026-02-18T03:34:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:56 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/2162819704' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:34:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:58 trial034 ceph-mon[21825]: pgmap v358: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.39k op/s 2026-02-18T03:34:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:58 trial086 ceph-mon[73228]: pgmap v358: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.39k op/s 2026-02-18T03:34:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:58 trial155 ceph-mon[76401]: pgmap v358: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.39k op/s 2026-02-18T03:35:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:34:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1893349120' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:34:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1893349120' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:34:59 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/1893349120' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:00 trial034 ceph-mon[21825]: pgmap v359: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:35:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:00 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3124967675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:00 trial086 ceph-mon[73228]: pgmap v359: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:35:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:00 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3124967675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:00 trial155 ceph-mon[76401]: pgmap v359: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:35:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:00 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/3124967675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 214.50 2.4M 2.2M 0.0k 23.5M 21.9M 0.0k nvme12n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.1M 2.2M 0.0k 20.8M 22.0M 0.0k nvme16n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 206.00 2.1M 2.2M 0.0k 21.0M 22.0M 0.0k nvme20n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.00 2.2M 2.2M 0.0k 21.7M 22.3M 0.0k nvme24n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.30 2.2M 2.2M 0.0k 22.4M 22.2M 0.0k nvme28n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 223.70 2.4M 2.2M 0.0k 24.4M 22.2M 0.0k nvme32n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 2.1M 2.1M 0.0k 20.6M 21.0M 0.0k nvme36n3 2026-02-18T03:35:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 209.60 2.3M 2.2M 0.0k 22.7M 22.2M 0.0k nvme40n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.80 2.0M 2.1M 0.0k 20.5M 21.0M 0.0k nvme44n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 214.10 2.2M 2.2M 0.0k 21.9M 21.8M 0.0k nvme48n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 2.0M 2.1M 0.0k 20.3M 21.1M 0.0k nvme4n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 2.1M 2.1M 0.0k 21.4M 21.3M 0.0k nvme52n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 2.0M 2.1M 0.0k 20.2M 21.3M 0.0k nvme56n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 212.10 2.2M 2.1M 0.0k 22.0M 20.8M 0.0k nvme60n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.0M 2.1M 0.0k 20.1M 21.5M 0.0k nvme64n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 2.2M 2.2M 0.0k 21.9M 21.7M 0.0k nvme8n3 2026-02-18T03:35:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3737542102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:02 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3737542102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:02 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3737542102' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:03 trial034 ceph-mon[21825]: pgmap v360: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.43k op/s 2026-02-18T03:35:03.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:03 trial086 ceph-mon[73228]: pgmap v360: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.43k op/s 2026-02-18T03:35:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:03 trial155 ceph-mon[76401]: pgmap v360: 33 pgs: 33 active+clean; 16 GiB data, 38 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.43k op/s 2026-02-18T03:35:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3197765003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:04 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3197765003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:04.378 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:04 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/3197765003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:05 trial034 ceph-mon[21825]: pgmap v361: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.48k op/s 2026-02-18T03:35:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:05 trial086 ceph-mon[73228]: pgmap v361: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.48k op/s 2026-02-18T03:35:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:05 trial155 ceph-mon[76401]: pgmap v361: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.48k op/s 2026-02-18T03:35:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:07 trial034 ceph-mon[21825]: pgmap v362: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.26k op/s 2026-02-18T03:35:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2595217984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:07 trial086 ceph-mon[73228]: pgmap v362: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.26k op/s 2026-02-18T03:35:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:07 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2595217984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:07 trial155 ceph-mon[76401]: pgmap v362: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.26k op/s 2026-02-18T03:35:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:07 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2595217984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:08.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:08 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1167688960' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:08 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1167688960' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:08 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/1167688960' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:09.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:09 trial034 ceph-mon[21825]: pgmap v363: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.39k op/s 2026-02-18T03:35:09.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3063887810' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:09 trial086 ceph-mon[73228]: pgmap v363: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.39k op/s 2026-02-18T03:35:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3063887810' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:09 trial155 ceph-mon[76401]: pgmap v363: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.39k op/s 2026-02-18T03:35:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:09 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3063887810' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:11 trial034 ceph-mon[21825]: pgmap v364: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:35:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/802407062' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:11 trial086 ceph-mon[73228]: pgmap v364: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:35:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:11 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/802407062' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:11 trial155 ceph-mon[76401]: pgmap v364: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:35:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:11 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/802407062' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:11.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.0M 2.2M 0.0k 19.8M 21.6M 0.0k nvme12n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.0M 2.2M 0.0k 20.2M 21.6M 0.0k nvme16n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 2.1M 2.1M 0.0k 20.5M 20.9M 0.0k nvme20n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 2.1M 2.1M 0.0k 20.9M 20.6M 0.0k nvme24n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 205.60 2.2M 2.2M 0.0k 21.5M 22.3M 0.0k nvme28n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 220.60 2.2M 2.0M 0.0k 21.8M 20.3M 0.0k nvme32n3 2026-02-18T03:35:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 206.90 2.1M 2.2M 0.0k 20.6M 21.8M 0.0k nvme36n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.0M 2.0M 0.0k 19.7M 19.9M 0.0k nvme40n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.20 2.1M 2.1M 0.0k 20.8M 20.5M 0.0k nvme44n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.80 2.1M 2.1M 0.0k 21.0M 20.9M 0.0k nvme48n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.90 2.2M 2.1M 0.0k 22.4M 21.2M 0.0k nvme4n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.0M 2.1M 0.0k 20.0M 21.0M 0.0k nvme52n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.0M 2.1M 0.0k 19.8M 20.8M 0.0k nvme56n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.0M 2.2M 0.0k 20.4M 21.9M 0.0k nvme60n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 2.2M 2.0M 0.0k 22.1M 20.4M 0.0k nvme64n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.70 2.1M 2.1M 0.0k 21.1M 20.7M 0.0k nvme8n3 2026-02-18T03:35:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:12 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:12.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:12 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:12.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:12.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:12.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:12.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:12 trial155 ceph-mon[76401]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:13.264 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:35:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:13 trial086 ceph-mon[73228]: pgmap v365: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.42k op/s 2026-02-18T03:35:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:13 trial155 ceph-mon[76401]: pgmap v365: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.42k op/s 2026-02-18T03:35:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:13 trial034 ceph-mon[21825]: pgmap v365: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.42k op/s 2026-02-18T03:35:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:14 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3943379572' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:14 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/3943379572' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:14.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3943379572' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:15 trial086 ceph-mon[73228]: pgmap v366: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.46k op/s 2026-02-18T03:35:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:15 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3686275468' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:15 trial155 ceph-mon[76401]: pgmap v366: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.46k op/s 2026-02-18T03:35:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:15 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/3686275468' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:15 trial034 ceph-mon[21825]: pgmap v366: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.46k op/s 2026-02-18T03:35:15.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3686275468' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:16.296 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1696744742' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1696744742' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:16 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/1696744742' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:17 trial086 ceph-mon[73228]: pgmap v367: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.24k op/s 2026-02-18T03:35:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:17 trial155 ceph-mon[76401]: pgmap v367: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.24k op/s 2026-02-18T03:35:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:17 trial034 ceph-mon[21825]: pgmap v367: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.24k op/s 2026-02-18T03:35:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:18 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/920842862' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:18 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/920842862' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:18.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/920842862' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:19 trial086 ceph-mon[73228]: pgmap v368: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.36k op/s 2026-02-18T03:35:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:19 trial155 ceph-mon[76401]: pgmap v368: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.36k op/s 2026-02-18T03:35:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:19 trial034 ceph-mon[21825]: pgmap v368: 33 pgs: 33 active+clean; 16 GiB data, 39 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.36k op/s 2026-02-18T03:35:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:21 trial086 ceph-mon[73228]: pgmap v369: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:35:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:21 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/394160696' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:21 trial155 ceph-mon[76401]: pgmap v369: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:35:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:21 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/394160696' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:21 trial034 ceph-mon[21825]: pgmap v369: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:35:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/394160696' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:21.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 214.40 2.2M 2.0M 0.0k 22.4M 19.9M 0.0k nvme12n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 213.80 2.2M 2.1M 0.0k 22.0M 20.6M 0.0k nvme16n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.60 2.0M 2.0M 0.0k 20.4M 20.4M 0.0k nvme20n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.0M 2.1M 0.0k 20.3M 20.5M 0.0k nvme24n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.0M 2.1M 0.0k 19.7M 21.0M 0.0k nvme28n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.30 2.0M 2.0M 0.0k 19.6M 20.3M 0.0k nvme32n3 2026-02-18T03:35:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 220.50 2.3M 2.0M 0.0k 22.5M 20.4M 0.0k nvme36n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 1.8M 2.1M 0.0k 18.4M 20.8M 0.0k nvme40n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.0M 2.0M 0.0k 19.8M 20.4M 0.0k nvme44n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 215.20 2.2M 2.0M 0.0k 22.1M 20.5M 0.0k nvme48n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.0M 2.1M 0.0k 19.7M 21.3M 0.0k nvme4n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.40 1.9M 2.0M 0.0k 18.8M 20.3M 0.0k nvme52n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 213.50 2.1M 2.0M 0.0k 21.3M 20.3M 0.0k nvme56n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 2.1M 2.0M 0.0k 20.6M 19.6M 0.0k nvme60n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 2.1M 2.1M 0.0k 21.2M 20.5M 0.0k nvme64n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 214.50 2.2M 2.0M 0.0k 21.9M 20.3M 0.0k nvme8n3 2026-02-18T03:35:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:22 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2797756649' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:22.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:22 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/2797756649' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:22 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2797756649' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:23.315 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:23 trial086 ceph-mon[73228]: pgmap v370: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.40k op/s 2026-02-18T03:35:23.316 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:23 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3797338909' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:23 trial155 ceph-mon[76401]: pgmap v370: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.40k op/s 2026-02-18T03:35:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:23 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3797338909' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:23 trial034 ceph-mon[21825]: pgmap v370: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.40k op/s 2026-02-18T03:35:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3797338909' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:25 trial086 ceph-mon[73228]: pgmap v371: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.47k op/s 2026-02-18T03:35:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2987147484' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:25 trial155 ceph-mon[76401]: pgmap v371: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.47k op/s 2026-02-18T03:35:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:25 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/2987147484' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:25.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:25 trial034 ceph-mon[21825]: pgmap v371: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.47k op/s 2026-02-18T03:35:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2987147484' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:27.321 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:27 trial155 ceph-mon[76401]: pgmap v372: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:27 trial086 ceph-mon[73228]: pgmap v372: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:27 trial034 ceph-mon[21825]: pgmap v372: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4072350458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:28 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/4072350458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:28.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4072350458' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:29 trial086 ceph-mon[73228]: pgmap v373: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.37k op/s 2026-02-18T03:35:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:29 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1881905135' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:29 trial155 ceph-mon[76401]: pgmap v373: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.37k op/s 2026-02-18T03:35:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:29 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/1881905135' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:29 trial034 ceph-mon[21825]: pgmap v373: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.37k op/s 2026-02-18T03:35:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:29 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1881905135' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:30.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:35:30.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:35:30.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:35:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:30 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2767505026' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:30 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/2767505026' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2767505026' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:31 trial086 ceph-mon[73228]: pgmap v374: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.34k op/s 2026-02-18T03:35:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:31 trial155 ceph-mon[76401]: pgmap v374: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.34k op/s 2026-02-18T03:35:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:31 trial034 ceph-mon[21825]: pgmap v374: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.34k op/s 2026-02-18T03:35:31.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:31.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 214.30 2.1M 2.0M 0.0k 21.3M 19.8M 0.0k nvme12n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 216.00 2.2M 1.9M 0.0k 22.2M 19.0M 0.0k nvme16n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.20 1.9M 2.0M 0.0k 19.0M 19.7M 0.0k nvme20n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 2.0M 1.9M 0.0k 19.9M 19.0M 0.0k nvme24n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 213.50 2.0M 2.0M 0.0k 20.2M 20.0M 0.0k nvme28n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 222.00 2.2M 2.1M 0.0k 21.8M 20.5M 0.0k nvme32n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 208.20 2.0M 1.9M 0.0k 19.8M 19.1M 0.0k nvme36n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.00 2.0M 2.0M 0.0k 20.4M 19.7M 0.0k nvme40n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 1.8M 2.0M 0.0k 18.4M 20.0M 0.0k nvme44n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.10 2.0M 2.1M 0.0k 20.0M 20.5M 0.0k nvme48n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 1.9M 1.9M 0.0k 18.7M 19.5M 0.0k nvme4n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.50 2.1M 2.1M 0.0k 21.5M 20.7M 0.0k nvme52n3 2026-02-18T03:35:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 1.9M 2.1M 0.0k 19.2M 20.7M 0.0k nvme56n3 2026-02-18T03:35:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 1.9M 2.0M 0.0k 18.9M 20.1M 0.0k nvme60n3 2026-02-18T03:35:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.20 2.0M 2.0M 0.0k 20.1M 20.1M 0.0k nvme64n3 2026-02-18T03:35:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 1.9M 2.0M 0.0k 18.6M 19.9M 0.0k nvme8n3 2026-02-18T03:35:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:32 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4104124829' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:32 trial155 ceph-mon[76401]: from='client.? 10.20.193.155:0/4104124829' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:32.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4104124829' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:32.579 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:35:32.579 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:35:32.580 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:35:32.609 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:32.609 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:31:26 UTC; 4min 6s ago 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80884 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Process: 80885 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 80963 (conmon) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 344.8M (peak: 347.5M) 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 16min 14.897s 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80965 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.610 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80967 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─80985 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─81480 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: │ └─81534 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: └─80963 /usr/bin/conmon --api-version 1 -c fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -u fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata -p /run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: states { 2026-02-18T03:35:32.611 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: grp_id: 2 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: state: INACCESSIBLE 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: } 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:34:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: ], , client address: IPv4 10.20.193.34:39820 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:35:32.612 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:35:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:29] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:35:32.613 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:35:32.647 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:34:09 UTC; 1min 22s ago 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Process: 75212 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Process: 75213 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 75291 (conmon) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 322.1M (peak: 324.7M) 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 5min 22.322s 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 2026-02-18T03:35:32.648 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─75293 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─75295 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─75312 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─75687 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: │ └─75692 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: └─75291 /usr/bin/conmon --api-version 1 -c 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 -u 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42/userdata -p /run/containers/storage/overlay-containers/7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.276177] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000318 seconds 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.292069] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000258 seconds 2026-02-18T03:35:32.649 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.308043] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000226 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.332068] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000234 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.348023] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000204 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.363989] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000166 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.380080] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000268 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.395989] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000181 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.412036] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000218 seconds 2026-02-18T03:35:32.650 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:34:30 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:34:30.428024] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000202 seconds 2026-02-18T03:35:32.651 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:35:32.687 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:32.687 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:35:32.687 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 1min 22s ago 2026-02-18T03:35:32.687 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.687 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 318.1M (peak: 320.3M) 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 5min 17.733s 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:35:32.688 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.592481] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000293 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.608532] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000310 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.620511] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000294 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.632559] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000333 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.649310] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.001090 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.668748] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000360 seconds 2026-02-18T03:35:32.689 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.681482] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.001248 seconds 2026-02-18T03:35:32.690 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.696523] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000301 seconds 2026-02-18T03:35:32.690 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.712557] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000341 seconds 2026-02-18T03:35:32.690 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:34:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:34:31.736541] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000315 seconds 2026-02-18T03:35:32.691 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:33:04 UTC; 2min 28s ago 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout: Process: 38731 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout: Process: 38732 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:35:32.722 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 38809 (conmon) 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 362.1M (peak: 363.3M) 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 10min 8.466s 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38811 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38813 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─38905 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─39111 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: │ └─39116 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:35:32.723 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout: └─38809 /usr/bin/conmon --api-version 1 -c dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa -u dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata -p /run/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: states { 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: grp_id: 3 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: state: INACCESSIBLE 2026-02-18T03:35:32.724 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: } 2026-02-18T03:35:32.725 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:34:28 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: ], , client address: IPv4 10.20.193.177:39072 2026-02-18T03:35:32.726 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:35:32.950 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:35:32.950 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 4m ago 10m trial034=x;count:1 2026-02-18T03:35:32.951 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 4m ago 10m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:35:32.951 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 4m ago 9m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:35:32.951 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 4m ago 9m trial155 2026-02-18T03:35:32.959 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:35:33.141 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:35:33.141 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (4m) 4m ago 8m 54.8M - 1.6.5 99a57256b38c fcedd7379c32 2026-02-18T03:35:33.141 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (83s) 82s ago 5m 53.3M - 1.6.5 99a57256b38c 7d1deb209c50 2026-02-18T03:35:33.141 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (83s) 82s ago 5m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:35:33.141 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (2m) 82s ago 2m 356M - 1.6.5 99a57256b38c dab76d38e575 2026-02-18T03:35:33.150 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:35:33.347 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:33 trial086 ceph-mon[73228]: pgmap v375: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.42k op/s 2026-02-18T03:35:33.368 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:35:33.378 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:35:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:33 trial155 ceph-mon[76401]: pgmap v375: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.42k op/s 2026-02-18T03:35:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:33 trial034 ceph-mon[21825]: pgmap v375: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.42k op/s 2026-02-18T03:35:33.594 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:35:33.594 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 84s) [leader: a] 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 11m) 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:35:33.595 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: usage: 40 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: client: 33 MiB/s rd, 33 MiB/s wr, 1.72k op/s rd, 1.70k op/s wr 2026-02-18T03:35:33.596 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:35:33.604 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:35:33.836 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:35:33.836 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 154, 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 4, 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 62, 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:35:33.837 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:35:33.838 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:35:33.839 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:35:33.840 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:35:33.841 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:35:33.841 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:35:33.849 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:35:33.908 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.909 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.910 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.911 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.912 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.913 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.914 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:35:33.915 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:35:33.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:33.963 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:35:34.009 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.009 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:35:34.053 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.054 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:35:34.099 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.100 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:35:34.143 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.145 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:35:34.190 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.191 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:35:34.237 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.237 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:35:34.282 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.283 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:35:34.327 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.327 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:35:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:34 trial086 ceph-mon[73228]: from='client.70183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/355635083' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:35:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4260387894' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:35:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2968902609' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:35:34.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:34 trial155 ceph-mon[76401]: from='client.70183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:34.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:34 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/355635083' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:35:34.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:34 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/4260387894' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:35:34.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:34 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2968902609' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:35:34.412 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.413 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:35:34.458 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.458 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:35:34.502 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.503 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:35:34.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:34 trial034 ceph-mon[21825]: from='client.70183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/355635083' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:35:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4260387894' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:35:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2968902609' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:35:34.549 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.550 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:35:34.596 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.597 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:35:34.643 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.643 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:35:34.688 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.689 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:35:34.733 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.734 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:35:34.818 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.820 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:35:34.903 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.904 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:35:34.989 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:34.990 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:35:35.035 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.036 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:35:35.081 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.081 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:35:35.126 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.127 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:35:35.171 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.172 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:35:35.216 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.217 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:35:35.262 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.262 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:35:35.307 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.308 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:35:35.353 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.354 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:35:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:35 trial086 ceph-mon[73228]: from='client.66494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:35 trial086 ceph-mon[73228]: pgmap v376: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.48k op/s 2026-02-18T03:35:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2093437031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:35.399 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.400 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:35:35.443 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.444 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:35:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:35 trial155 ceph-mon[76401]: from='client.66494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:35 trial155 ceph-mon[76401]: pgmap v376: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.48k op/s 2026-02-18T03:35:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:35 trial155 ceph-mon[76401]: from='client.? 10.20.193.177:0/2093437031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:35.489 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.490 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:35:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:35 trial034 ceph-mon[21825]: from='client.66494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:35 trial034 ceph-mon[21825]: pgmap v376: 33 pgs: 33 active+clean; 16 GiB data, 40 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.48k op/s 2026-02-18T03:35:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2093437031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:35.534 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.535 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:35:35.581 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.581 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:35:35.625 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.627 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:35:35.672 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.672 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:35:35.716 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.718 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:35:35.762 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.763 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:35:35.807 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.808 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:35:35.853 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.854 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:35:35.901 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.902 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:35:35.947 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.948 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:35:35.993 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:35.994 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:35:36.040 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.041 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:35:36.086 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.088 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:35:36.131 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.133 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:35:36.178 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.179 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:35:36.225 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.225 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:35:36.270 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.271 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:35:36.316 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.317 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:35:36.361 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.362 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:35:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:36 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1968519153' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:36.407 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.408 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:35:36.452 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.453 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:35:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:36 trial155 ceph-mon[76401]: from='client.? 10.20.193.86:0/1968519153' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:36.497 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.498 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:35:36.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:36 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1968519153' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:36.543 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.544 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:35:36.589 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.590 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:35:36.635 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.636 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:35:36.682 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.683 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:35:36.728 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.729 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:35:36.773 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.774 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:35:36.819 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.820 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:35:36.865 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.866 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:35:36.910 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.911 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:35:36.955 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:36.956 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:35:37.002 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:35:37.003 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:35:37.003 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:35:37.003 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.a 2026-02-18T03:35:37.003 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon rm nvmeof.nvmeof.a 2026-02-18T03:35:37.004 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:35:37.004 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:35:37.004 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:35:37.267 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":87,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:35:37.279 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-mon[21825]: pgmap v377: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:37.279 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3406836602' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:37.280 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:35:37.280 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:35:37.280 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:35:37.280 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 686781, 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:35:37.358 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 87, 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.359 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:35:37.360 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.361 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.362 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:37.363 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:35:37.364 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.365 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.366 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.367 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.368 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.369 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.370 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.371 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.372 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.373 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "num": 61 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.374 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:35:37.375 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:35:37.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:37 trial086 ceph-mon[73228]: pgmap v377: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:37.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:37 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3406836602' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:37.376 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:37 trial155 ceph-mon[76401]: pgmap v377: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.25k op/s 2026-02-18T03:35:37.376 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:37 trial155 ceph-mon[76401]: from='client.? 10.20.193.34:0/3406836602' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:37.378 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:35:37.378 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:35:37.378 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:35:37.460 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 251761, 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:35:37.461 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 88, 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.462 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.463 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.464 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:35:37.465 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.466 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:37.467 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.468 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.469 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.470 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.471 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.472 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:37.473 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.474 INFO:teuthology.orchestra.run.trial034.stdout: "num": 56 2026-02-18T03:35:37.475 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.475 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.475 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.475 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:35:37.475 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:35:37.479 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:35:37.479 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:35:37.480 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 26, 2026-02-18T03:35:37.562 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 88368, 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 88, 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.563 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.564 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.565 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:35:37.566 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:37.567 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.568 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.569 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.570 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.571 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.572 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:37.573 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:35:37.574 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: "num": 33 2026-02-18T03:35:37.575 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:37.576 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:37.576 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:37.576 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:35:37.576 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:35:37.576 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:37 trial034 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:37.576 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:37] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:35:37.577 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:37] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:35:37.577 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.34:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.34:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:35:37.577 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:35:37.578 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:35:37.578 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['c'] 2026-02-18T03:35:37.578 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:35:37.578 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.c 2026-02-18T03:35:37.579 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.c 2026-02-18T03:35:37.579 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:35:37.579 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:35:37.916 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:37 trial155 systemd[1]: Stopping Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:37.917 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[76397]: 2026-02-18T03:35:37.711+0000 7ff32b12a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:35:37.917 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:35:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[76397]: 2026-02-18T03:35:37.711+0000 7ff32b12a640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:35:38.006 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service' 2026-02-18T03:35:38.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:35:38.047 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:35:38.047 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:35:38.048 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:35:38.302 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":88,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:40] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:40] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:40] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:40] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:40 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:40] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial034) 2026-02-18T03:35:41.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:41] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:35:41.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:41] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:35:41.316 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:41] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[80963]: [18-Feb-2026 03:35:41] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 podman[93717]: 2026-02-18 03:35:41.115971394 +0000 UTC m=+3.682049857 container died fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, architecture=x86_64, io.ceph.git.branch=devel, version=1.6.5, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.buildah.version=1.29.0, summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.build.makeflags=, vendor=Red Hat, Inc., io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.branch=undefined, io.openshift.wants=ceph,rbd, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.version=9.0-30.el9, io.spdk.build.ceph-release=20.2.0, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, release=, io.ceph.nvmeof=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, build-date=2026-02-11 09:53:49 UTC, io.spdk.version=25.09, vcs-type=git, maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 podman[93717]: 2026-02-18 03:35:41.128988207 +0000 UTC m=+3.695066670 container remove fcedd7379c326df721962e6f65fbe4d1ceecc50e2072669d8ee9bfc1f699c3a6 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, build-date=2026-02-11 09:53:49 UTC, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, io.spdk.version=25.09, name=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, distribution-scope=public, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.buildah.version=1.29.0, io.spdk.build.target-arch=x86-64-v2, version=1.6.5, org.centos.version=9.0-30.el9, io.ceph.component=ceph-nvmeof, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, release=, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, io.ceph.nvmeof=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, architecture=x86_64, io.ceph.git.branch=devel) 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 bash[93717]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:35:41.341 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:35:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:41.342 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:41 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 16min 45.055s CPU time, 347.8M memory peak. 2026-02-18T03:35:41.557 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":92,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:35:41.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:41.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 2.0M 1.9M 0.0k 20.1M 19.1M 0.0k nvme12n3 2026-02-18T03:35:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.40 2.0M 1.9M 0.0k 19.7M 19.1M 0.0k nvme16n3 2026-02-18T03:35:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 1.9M 1.9M 0.0k 19.3M 18.6M 0.0k nvme20n3 2026-02-18T03:35:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 1.9M 2.0M 0.0k 19.1M 19.6M 0.0k nvme24n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 1.9M 2.0M 0.0k 18.8M 19.6M 0.0k nvme28n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.10 1.9M 1.9M 0.0k 19.2M 19.4M 0.0k nvme32n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 2.0M 1.9M 0.0k 19.7M 18.6M 0.0k nvme36n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.00 2.0M 1.9M 0.0k 20.1M 19.3M 0.0k nvme40n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 1.9M 1.9M 0.0k 19.2M 19.2M 0.0k nvme44n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 1.9M 1.9M 0.0k 18.8M 18.8M 0.0k nvme48n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.90 1.9M 1.8M 0.0k 19.3M 18.4M 0.0k nvme4n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 1.9M 1.9M 0.0k 19.2M 19.5M 0.0k nvme52n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.30 1.9M 1.9M 0.0k 18.9M 19.1M 0.0k nvme56n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.60 1.9M 1.9M 0.0k 19.1M 19.5M 0.0k nvme60n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 1.9M 2.0M 0.0k 19.1M 19.7M 0.0k nvme64n3 2026-02-18T03:35:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 1.8M 1.9M 0.0k 17.8M 18.7M 0.0k nvme8n3 2026-02-18T03:35:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:44.570 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:35:44.817 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":95,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:35:47.829 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:35:51.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:51.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 214.70 1.8M 2.0M 0.0k 18.5M 20.0M 0.0k nvme12n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.40 1.9M 1.9M 0.0k 18.5M 19.4M 0.0k nvme16n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.90 1.8M 1.9M 0.0k 18.4M 19.1M 0.0k nvme20n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 216.30 2.0M 1.9M 0.0k 19.7M 19.4M 0.0k nvme24n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.0M 1.9M 0.0k 19.6M 18.6M 0.0k nvme28n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 218.90 1.9M 1.9M 0.0k 19.3M 19.0M 0.0k nvme32n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 226.60 2.3M 2.0M 0.0k 22.9M 20.1M 0.0k nvme36n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 211.10 1.9M 1.9M 0.0k 18.8M 19.3M 0.0k nvme40n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 216.00 2.0M 1.9M 0.0k 19.9M 19.4M 0.0k nvme44n3 2026-02-18T03:35:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 216.40 1.9M 2.0M 0.0k 19.1M 19.8M 0.0k nvme48n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 1.9M 1.9M 0.0k 19.2M 19.0M 0.0k nvme4n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 1.8M 1.9M 0.0k 18.1M 19.0M 0.0k nvme52n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 213.90 2.0M 1.9M 0.0k 19.6M 19.3M 0.0k nvme56n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.00 1.9M 1.9M 0.0k 18.6M 18.9M 0.0k nvme60n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.00 1.9M 1.9M 0.0k 19.1M 18.9M 0.0k nvme64n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.40 1.9M 1.9M 0.0k 18.8M 19.2M 0.0k nvme8n3 2026-02-18T03:35:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.104917] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.105287] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.112705] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.112751] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117099] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117146] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117569] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117604] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117954] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.117971] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.118232] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.118247] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.118621] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.118652] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.119055] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.119077] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.119569] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.119596] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.120367] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.120391] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.120726] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.120741] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121147] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121163] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121537] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121549] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121920] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.121950] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122248] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122265] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122527] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122540] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122841] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.122854] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123217] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123233] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123572] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123591] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123978] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.123998] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.124315] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.124339] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.124693] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.124718] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.134869] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.134905] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137314] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137342] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137653] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137670] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137936] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.137952] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.140623] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.140646] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141064] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141086] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141467] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141481] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141756] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.141771] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.142226] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.142240] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.142646] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.142661] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143064] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143077] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143479] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143500] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143812] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.143835] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144060] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144077] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144533] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144558] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144893] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.144920] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.145289] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.145309] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.145598] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.145618] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.146012] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.146030] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.153603] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.153628] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161052] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161084] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161503] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161526] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161940] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.161960] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.162420] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.162438] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.165782] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.165814] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.166173] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.166189] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.168439] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.168469] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.170416] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.170447] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.170942] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.170970] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.171373] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.171392] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.171753] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.171774] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.172136] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.172158] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.173985] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.174010] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.174415] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.174430] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.174836] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.174862] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.175247] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.175266] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.175603] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.175624] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.195309] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.195370] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.196069] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.196095] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.196528] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.196550] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.204926] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.204956] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.205384] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:35:52.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [2026-02-18 03:35:52.205404] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:35:52.476 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":30,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:35:52.487 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:35:52.487 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:35:52.487 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 30, 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 702072, 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.650 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.651 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.652 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:52.653 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.654 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "num": 43 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:35:52.655 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:35:52.658 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:35:52.658 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:35:52.658 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 30, 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 267041, 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.740 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.741 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.742 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:35:52.743 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout: "num": 70 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:35:52.744 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:35:52.746 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:35:52.746 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 systemd[1]: Starting Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 podman[94631]: 2026-02-18 03:35:52.701341482 +0000 UTC m=+0.020477454 container create 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.openshift.wants=ceph,rbd, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.spdk.build.ceph-release=20.2.0, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, version=1.6.5, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, architecture=x86_64, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, io.spdk.git.branch=undefined, io.spdk.version=25.09, maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, release=, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.component=ubi9-container, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom) 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 podman[94631]: 2026-02-18 03:35:52.730641586 +0000 UTC m=+0.049777568 container init 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, vendor=Red Hat, Inc., io.spdk.build.makeflags=, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, io.openshift.wants=ceph,rbd, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, maintainer=Ceph Developers , vcs-type=git, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=, architecture=x86_64, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, build-date=2026-02-11 09:53:49 UTC, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.nvmeof=, io.ceph.maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.branch=undefined, org.centos.version=9.0-30.el9, name=ceph-nvmeof) 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 podman[94631]: 2026-02-18 03:35:52.732730867 +0000 UTC m=+0.051866849 container start 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, version=1.6.5, io.spdk.version=25.09, io.ceph.url=https://github.com/ceph/ceph-nvmeof, release=, io.ceph.git.branch=devel, io.ceph.version=1.6.5, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, org.centos.version=9.0-30.el9, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, distribution-scope=public, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., architecture=x86_64, io.ceph.maintainer=Ceph Developers , vcs-type=git, io.spdk.git.branch=undefined, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=20.2.0, com.redhat.component=ubi9-container, name=ceph-nvmeof) 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 bash[94631]: 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 podman[94631]: 2026-02-18 03:35:52.691919568 +0000 UTC m=+0.011055570 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:35:52.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 systemd[1]: Started Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:53.092 INFO:teuthology.orchestra.run.trial034.stdout:Removed nvmeof.nvmeof.a from host 'trial034' 2026-02-18T03:35:53.102 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.b 2026-02-18T03:35:53.102 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon rm nvmeof.nvmeof.b 2026-02-18T03:35:53.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a, using rotation 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [gateway] 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): name = client.nvmeof.nvmeof.a 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): port = 5500 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:35:53.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.51624 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.a"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Remove daemons nvmeof.nvmeof.a 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Removing daemon nvmeof.nvmeof.a from trial034 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v378: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/654641397' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3732760149' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v379: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.34k op/s 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.a 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1735026326' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v380: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.42k op/s 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1855334307' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1296200828' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v381: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.50k op/s 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/434943997' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Health check failed: 2 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v382: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.30k op/s 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: mon.b calling monitor election 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v383: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.44k op/s 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v384: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.39k op/s 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: pgmap v385: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.49k op/s 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:35:53.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:35:53.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 11m) 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"}]': finished 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: nvmeof.nvmeof.a removed from nvmeof gateways dashboard config 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: gateway address: 10.20.193.34 from map_addr=None spec.addr=None host_ip='10.20.193.34' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: discovery address: 10.20.193.34 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.34' 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/81002058' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1300774416' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:35:53.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): force_tls = False 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:35:53.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [discovery] 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): port = 8009 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [ceph] 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): pool = mypool 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): id = nvmeof.nvmeof.a 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [mtls] 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [spdk] 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): transports = tcp 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): [monitor] 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:35:53.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.a 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:52] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.34:5499 for group id 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.a group id=0 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:35:53.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:53] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.51624 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.a"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Remove daemons nvmeof.nvmeof.a 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Removing daemon nvmeof.nvmeof.a from trial034 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v378: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/654641397' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3732760149' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v379: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.34k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Removing key for client.nvmeof.nvmeof.a 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1735026326' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v380: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.42k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1855334307' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1296200828' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v381: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.50k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/434943997' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Health check failed: 2 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v382: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.30k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: mon.b calling monitor election 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: mon.a calling monitor election 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v383: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.44k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v384: 33 pgs: 33 active+clean; 16 GiB data, 41 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.39k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: pgmap v385: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.49k op/s 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: monmap epoch 3 2026-02-18T03:35:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: min_mon_release 20 (tentacle) 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: election_strategy: 1 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: fsmap 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: osdmap e54: 8 total, 8 up, 8 in 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: mgrmap e15: x(active, since 11m) 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.a"}]': finished 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: nvmeof.nvmeof.a removed from nvmeof gateways dashboard config 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: gateway address: 10.20.193.34 from map_addr=None spec.addr=None host_ip='10.20.193.34' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: discovery address: 10.20.193.34 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.34' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/81002058' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1300774416' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-18T03:35:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.86:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.86:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial086) 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:35:53.799 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[75291]: [18-Feb-2026 03:35:53] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 podman[85748]: 2026-02-18 03:35:53.839063984 +0000 UTC m=+0.277584531 container died 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, vcs-type=git, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , name=ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.ceph.git.branch=devel, io.spdk.build.makeflags=, summary=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., architecture=x86_64, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.branch=undefined, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, io.buildah.version=1.29.0, distribution-scope=public, release=, version=1.6.5, com.redhat.component=ubi9-container, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug) 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 podman[85748]: 2026-02-18 03:35:53.851499722 +0000 UTC m=+0.290020259 container remove 7d1deb209c5043e1247764a64304a1cef33fc70c15c36eae630f2c6445fd5c42 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.version=25.09, summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, build-date=2026-02-11 09:53:49 UTC, name=ceph-nvmeof, io.ceph.nvmeof=, io.openshift.wants=ceph,rbd, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.ceph.maintainer=Ceph Developers , io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, release=, com.redhat.component=ubi9-container, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, version=1.6.5, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, distribution-scope=public, io.ceph.component=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., vcs-type=git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 bash[85748]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:54.089 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:53 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 6min 46.282s CPU time, 326.5M memory peak. 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: Deploying daemon nvmeof.nvmeof.a on trial034 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: Adjusting osd_memory_target on trial086 to 28015M 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:54 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:54.508 INFO:teuthology.orchestra.run.trial086.stdout:Removed nvmeof.nvmeof.b from host 'trial086' 2026-02-18T03:35:54.517 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:35:54.518 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.d 2026-02-18T03:35:54.518 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon rm nvmeof.nvmeof.d 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.a on trial034 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial086 to 28015M 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:54 trial177 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:54] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:35:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:54] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:35:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:54] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.177:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.177:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:35:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:54] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:35:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='client.66635 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.b"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: Remove daemons nvmeof.nvmeof.b 2026-02-18T03:35:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: Removing daemon nvmeof.nvmeof.b from trial086 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: pgmap v387: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.40k op/s 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.b"}]': finished 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:55 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:55.383 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='client.66635 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.b"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:55.383 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: Remove daemons nvmeof.nvmeof.b 2026-02-18T03:35:55.383 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: Removing daemon nvmeof.nvmeof.b from trial086 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:55.383 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: pgmap v387: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.40k op/s 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.b"}]': finished 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:55.384 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: INFO: Setting log level to WARNING 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.112209] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.112256] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.226847] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.257406] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.257418] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:35:55.385 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.257431] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:35:55.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.257432] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:35:55.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:35:55.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:35:55.386 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.382474] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO discovery.py:369 (78): discovery addr: 10.20.193.34 port: 8009 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.425870] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.425906] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial034). 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial034). 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO state.py:2073 (78): Initialization is over (discovery-trial034). 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.640 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:35:55.641 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.750551] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.34:0/3688387682, rc 0 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.750632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.34:0/3688387682 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.34:0/3688387682' 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.763533] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.768090] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.768298] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.768317] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.872259] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.34:0/387743105, rc 0 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.873074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.34:0/387743105 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.34:0/387743105' 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.885817] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.891148] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:35:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.891172] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.b 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: nvmeof.nvmeof.b removed from nvmeof gateways dashboard config 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='client.66641 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.d"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: Remove daemons nvmeof.nvmeof.d 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: Removing daemon nvmeof.nvmeof.d from trial177 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/293237463' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/936620398' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:56.215 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.998584] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.34:0/4141761269, rc 0 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:55.998664] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.34:0/4141761269 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:55] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.34:0/4141761269' 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.011781] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.016240] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.016268] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.116131] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.34:0/2450388660, rc 0 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.117077] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.34:0/2450388660 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.34:0/2450388660' 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.130770] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.135427] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.135452] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: Removing key for client.nvmeof.nvmeof.b 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: nvmeof.nvmeof.b removed from nvmeof gateways dashboard config 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='client.66641 -' entity='client.admin' cmd=[{"prefix": "orch daemon rm", "names": ["nvmeof.nvmeof.d"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: Remove daemons nvmeof.nvmeof.d 2026-02-18T03:35:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: Removing daemon nvmeof.nvmeof.d from trial177 -- ports [5500, 4420, 8009, 10008] 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/293237463' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/936620398' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:56.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:56.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:56.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:56.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:56.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.243165] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.34:0/3273413772, rc 0 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.243375] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.34:0/3273413772 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.34:0/3273413772' 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.256066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.269341] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.269362] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.368229] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.34:0/806181468, rc 0 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.368291] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.34:0/806181468 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.34:0/806181468' 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.381594] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.386569] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.386591] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.490610] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.34:0/2515282051, rc 0 2026-02-18T03:35:56.564 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:35:56.564 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:35:56.564 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:35:56.564 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial177) 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[38809]: [18-Feb-2026 03:35:56] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 podman[50499]: 2026-02-18 03:35:56.423092097 +0000 UTC m=+1.510200719 container died dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=, io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, name=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.target-arch=x86-64-v2, io.ceph.nvmeof=, io.spdk.git.branch=undefined, build-date=2026-02-11 09:53:49 UTC, architecture=x86_64, io.spdk.build.ceph-release=20.2.0, io.spdk.build.pkgdep-args=--rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.maintainer=Ceph Developers , com.redhat.component=ubi9-container, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.version=25.09, summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , vcs-type=git, io.ceph.component=ceph-nvmeof, io.spdk.build.makeflags=, distribution-scope=public) 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 podman[50499]: 2026-02-18 03:35:56.434425868 +0000 UTC m=+1.521534490 container remove dab76d38e575427965f4efda8d2510424827cd9b526a8e80a07dc0788f452bfa (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, build-date=2026-02-11 09:53:49 UTC, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, architecture=x86_64, io.ceph.maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, org.centos.version=9.0-30.el9, com.redhat.component=ubi9-container, name=ceph-nvmeof, vendor=Red Hat, Inc., io.spdk.build.pkgdep-args=--rbd, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.spdk.version=25.09, maintainer=Ceph Developers , distribution-scope=public, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, url=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.spdk.build.makeflags=, version=1.6.5, io.spdk.git.branch=undefined, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, release=) 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 bash[50499]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:56.565 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:56 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 11min 44.806s CPU time, 370.2M memory peak. 2026-02-18T03:35:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 systemd[1]: Starting Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:56.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 podman[86333]: 2026-02-18 03:35:56.509375109 +0000 UTC m=+0.017958395 container create c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.nvmeof=, summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, distribution-scope=public, io.spdk.build.target-arch=x86-64-v2, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.spdk.version=25.09, io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-type=git, io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vendor=Red Hat, Inc., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, version=1.6.5, org.centos.version=9.0-30.el9, release=, io.spdk.build.pkgdep-args=--rbd, io.ceph.component=ceph-nvmeof, io.spdk.build.makeflags=, io.spdk.build.ceph-release=20.2.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, architecture=x86_64) 2026-02-18T03:35:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 podman[86333]: 2026-02-18 03:35:56.534225436 +0000 UTC m=+0.042808672 container init c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.target-arch=x86-64-v2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.branch=devel, io.ceph.component=ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.spdk.version=25.09, io.ceph.maintainer=Ceph Developers , version=1.6.5, io.ceph.nvmeof=, io.spdk.git.branch=undefined, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, release=, distribution-scope=public, build-date=2026-02-11 09:53:49 UTC, summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, architecture=x86_64, name=ceph-nvmeof) 2026-02-18T03:35:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 podman[86333]: 2026-02-18 03:35:56.536763468 +0000 UTC m=+0.045346704 container start c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.ceph-release=20.2.0, name=ceph-nvmeof, io.ceph.nvmeof=, io.ceph.maintainer=Ceph Developers , architecture=x86_64, vendor=Red Hat, Inc., io.spdk.version=25.09, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.wants=ceph,rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, maintainer=Ceph Developers , vcs-type=git, version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, distribution-scope=public, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, release=, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:35:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 bash[86333]: c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 2026-02-18T03:35:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 podman[86333]: 2026-02-18 03:35:56.501623095 +0000 UTC m=+0.010206321 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:35:56.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 systemd[1]: Started Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.491069] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.34:0/2515282051 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.34:0/2515282051' 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.504633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.509337] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.509363] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:56.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.613226] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.34:0/3736398104, rc 0 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.613298] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.34:0/3736398104 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.34:0/3736398104' 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.625342] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.629914] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.629940] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.725753] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.34:0/47565196, rc 0 2026-02-18T03:35:56.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.725819] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.34:0/47565196 2026-02-18T03:35:56.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.34:0/47565196' 2026-02-18T03:35:56.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.740582] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:35:56.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.745146] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:35:56.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.745172] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.848823] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.34:0/3324879211, rc 0 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.848889] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.34:0/3324879211 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.34:0/3324879211' 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.863917] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.868586] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.868610] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:56.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.975904] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.34:0/1566294731, rc 0 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.975965] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.34:0/1566294731 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.34:0/1566294731' 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.989150] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:56] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.994372] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:35:56.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:56.994395] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:35:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [gateway] 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): port = 5500 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:35:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:35:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.096 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:35:57.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): force_tls = False 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:35:57.098 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:35:57.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [discovery] 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): port = 8009 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:57.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [ceph] 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): pool = mypool 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [mtls] 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:35:57.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [spdk] 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): transports = tcp 2026-02-18T03:35:57.102 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): [monitor] 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:35:57.103 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:35:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:35:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:35:57.104 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:56] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.86:5499 for group id 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: pgmap v388: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.34k op/s 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"}]': finished 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:57.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.095022] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.34:0/2267872973, rc 0 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.095089] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.34:0/2267872973 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.34:0/2267872973' 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.107843] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.112627] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.112653] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.208603] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.34:0/3124580479, rc 0 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.208678] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.34:0/3124580479 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.34:0/3124580479' 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.223076] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.228243] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:35:57.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.228266] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: 2026-02-18T03:35:57.219+0000 7f3f799c9640 -1 log_channel(cephadm) log [ERR] : Failed to apply nvmeof.mypool.mygroup0 spec NvmeofServiceSpec.from_json(yaml.safe_load('''service_type: nvmeof 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: service_id: mypool.mygroup0 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: service_name: nvmeof.mypool.mygroup0 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: placement: 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: hosts: 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: - trial034=nvmeof.a 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: - trial086=nvmeof.b 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: - trial155=nvmeof.c 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: - trial177=nvmeof.d 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: spec: 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: abort_discovery_on_errors: true 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: abort_on_errors: true 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: abort_on_update_error: true 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: allowed_consecutive_spdk_ping_failures: 1 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: break_update_interval_sec: 25 2026-02-18T03:35:57.272 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: cluster_connections: 32 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: conn_retries: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: discovery_bind_retries_limit: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: discovery_bind_sleep_interval: 0.5 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: discovery_port: 8009 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: enable_monitor_client: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: enable_prometheus_exporter: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: group: mygroup0 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: log_directory: /var/log/ceph/ 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: log_files_enabled: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: log_files_rotation_enabled: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: log_level: INFO 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_gws_in_grp: 16 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_hosts: 2048 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_hosts_per_namespace: 16 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_hosts_per_subsystem: 128 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_log_directory_backups: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_log_file_size_in_mb: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_log_files_count: 20 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_message_length_in_mb: 4 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_namespaces: 4096 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_namespaces_per_subsystem: 512 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_namespaces_with_netmask: 1000 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_ns_to_change_lb_grp: 8 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_subsystems: 128 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: monitor_timeout: 1.0 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: notifications_interval: 60 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: omap_file_lock_duration: 20 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: omap_file_lock_on_read: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: omap_file_lock_retries: 30 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: omap_file_lock_retry_sleep_interval: 1.0 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: omap_file_update_reloads: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: pool: mypool 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: port: 5500 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: prometheus_connection_list_cache_expiration: 60 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: prometheus_port: 10008 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: prometheus_startup_delay: 240 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: prometheus_stats_interval: 10 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: rebalance_period_sec: 7 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: rpc_socket_dir: /var/tmp/ 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: rpc_socket_name: spdk.sock 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: spdk_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: spdk_ping_interval_in_seconds: 2.0 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: spdk_protocol_log_level: WARNING 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: spdk_timeout: 60.0 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: state_update_interval_sec: 5 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: state_update_notify: true 2026-02-18T03:35:57.273 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: subsystem_cache_expiration: 5 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: tgt_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: transport_tcp_options: 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: in_capsule_data_size: 8192 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: max_io_qpairs_per_ctrlr: 7 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: transports: tcp 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: verbose_log_messages: true 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: verify_keys: true 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: verify_listener_ip: true 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: verify_nqns: true 2026-02-18T03:35:57.274 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: ''')): Cannot place on trial177: Unknown hosts 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: pgmap v388: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.34k op/s 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: gateway address: 10.20.193.86 from map_addr=None spec.addr=None host_ip='10.20.193.86' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: discovery address: 10.20.193.86 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.86' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: Deploying daemon nvmeof.nvmeof.b on trial086 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.d"}]': finished 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.339409] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.34:0/2647946530, rc 0 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.339482] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.34:0/2647946530 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.34:0/2647946530' 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.352724] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.357261] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.357286] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.452880] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.34:0/783192635, rc 0 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.452947] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.34:0/783192635 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.34:0/783192635' 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.465965] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.470525] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.470550] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.567 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.566374] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.34:0/3408886239, rc 0 2026-02-18T03:35:57.806 INFO:teuthology.orchestra.run.trial177.stdout:Removed nvmeof.nvmeof.d from host 'trial177' 2026-02-18T03:35:57.816 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 71 secs before reviving 2026-02-18T03:35:57.826 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.567074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.34:0/3408886239 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.34:0/3408886239' 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.580075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.603250] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.603280] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.698733] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.34:0/2774705427, rc 0 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.698791] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.34:0/2774705427 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.34:0/2774705427' 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.711063] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.715552] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.715572] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.807129] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.34:0/669303432, rc 0 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.808087] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.34:0/669303432 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.34:0/669303432' 2026-02-18T03:35:57.827 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.826084] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.834303] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.834330] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.938314] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.34:0/396875284, rc 0 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.943089] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.34:0/396875284 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.34:0/396875284' 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.955841] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:57] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.960535] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:57.960556] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.052170] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.34:0/2561821655, rc 0 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.052236] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.34:0/2561821655 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.34:0/2561821655' 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.066075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.075321] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.075344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:58.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:35:58.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:35:58.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:35:58.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:35:58.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:35:58.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:57] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:35:58.370 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.170491] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.34:0/4095014947, rc 0 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.170564] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.34:0/4095014947 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.34:0/4095014947' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.184264] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.188859] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.188881] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.288651] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.34:0/1388786706, rc 0 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.288718] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.34:0/1388786706 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.34:0/1388786706' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.300941] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.305510] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.305534] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: Removing key for client.nvmeof.nvmeof.d 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: nvmeof.nvmeof.d removed from nvmeof gateways dashboard config 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:58.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:58.372 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: Removing key for client.nvmeof.nvmeof.d 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: nvmeof.nvmeof.d removed from nvmeof gateways dashboard config 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:35:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.d", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:35:58.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:58 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 systemd[1]: Starting Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 podman[51497]: 2026-02-18 03:35:58.371005884 +0000 UTC m=+0.017551351 container create aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, org.centos.version=9.0-30.el9, architecture=x86_64, io.spdk.build.ceph-release=20.2.0, version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, build-date=2026-02-11 09:53:49 UTC, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, io.ceph.maintainer=Ceph Developers , release=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.version=1.6.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.makeflags=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.git.branch=devel, com.redhat.component=ubi9-container, io.buildah.version=1.29.0) 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 podman[51497]: 2026-02-18 03:35:58.400997855 +0000 UTC m=+0.047543332 container init aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, version=1.6.5, io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.ceph-release=20.2.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, io.spdk.build.pkgdep-args=--rbd, vcs-type=git, maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, com.redhat.component=ubi9-container, io.spdk.git.branch=undefined, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.git.branch=devel, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.makeflags=, distribution-scope=public, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.version=25.09, release=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc.) 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 podman[51497]: 2026-02-18 03:35:58.403216379 +0000 UTC m=+0.049761836 container start aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.nvmeof=, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, io.ceph.git.branch=devel, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.openshift.wants=ceph,rbd, vcs-type=git, io.spdk.version=25.09, io.buildah.version=1.29.0, architecture=x86_64, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, distribution-scope=public, io.ceph.version=1.6.5, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.ceph.maintainer=Ceph Developers , name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/) 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 bash[51497]: aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 podman[51497]: 2026-02-18 03:35:58.363637986 +0000 UTC m=+0.010183453 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 systemd[1]: Started Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [gateway] 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:35:58.577 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): port = 5500 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:35:58.578 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): force_tls = False 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [discovery] 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): port = 8009 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [ceph] 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): pool = mypool 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.579 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [mtls] 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.401341] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.34:0/1547214263, rc 0 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.401411] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.34:0/1547214263 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.34:0/1547214263' 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.414580] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.419102] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:35:58.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.419125] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.531123] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.34:0/1488517427, rc 0 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.532083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.34:0/1488517427 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.34:0/1488517427' 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.545609] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.550141] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.550163] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.649919] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.34:0/1257725375, rc 0 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.650075] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.34:0/1257725375 2026-02-18T03:35:58.651 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.34:0/1257725375' 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.664107] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.668661] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.668683] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.772505] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.34:0/3273381360, rc 0 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.773080] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.34:0/3273381360 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.34:0/3273381360' 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.787258] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.792060] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.792084] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.895714] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.34:0/1009876173, rc 0 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.895795] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.34:0/1009876173 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.34:0/1009876173' 2026-02-18T03:35:58.909 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.908511] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [spdk] 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): transports = tcp 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): [monitor] 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.177:5499 for group id 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:35:58.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:35:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:35:58] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:35:59.211 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Removing trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Removing trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Removing trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Failed to apply nvmeof.mypool.mygroup0 spec NvmeofServiceSpec.from_json(yaml.safe_load('''service_type: nvmeof 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout: service_id: mypool.mygroup0 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout: service_name: nvmeof.mypool.mygroup0 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout: placement: 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout: hosts: 2026-02-18T03:35:59.212 INFO:journalctl@ceph.mon.a.trial034.stdout: - trial034=nvmeof.a 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: - trial086=nvmeof.b 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: - trial155=nvmeof.c 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: - trial177=nvmeof.d 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: spec: 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: abort_discovery_on_errors: true 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: abort_on_errors: true 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: abort_on_update_error: true 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: allowed_consecutive_spdk_ping_failures: 1 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: break_update_interval_sec: 25 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: cluster_connections: 32 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: conn_retries: 10 2026-02-18T03:35:59.213 INFO:journalctl@ceph.mon.a.trial034.stdout: discovery_bind_retries_limit: 10 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: discovery_bind_sleep_interval: 0.5 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: discovery_port: 8009 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_monitor_client: true 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_prometheus_exporter: true 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: group: mygroup0 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: log_directory: /var/log/ceph/ 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: log_files_enabled: true 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: log_files_rotation_enabled: true 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: log_level: INFO 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: max_gws_in_grp: 16 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: max_hosts: 2048 2026-02-18T03:35:59.214 INFO:journalctl@ceph.mon.a.trial034.stdout: max_hosts_per_namespace: 16 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_hosts_per_subsystem: 128 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_log_directory_backups: 10 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_log_file_size_in_mb: 10 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_log_files_count: 20 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_message_length_in_mb: 4 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_namespaces: 4096 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_namespaces_per_subsystem: 512 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_namespaces_with_netmask: 1000 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_ns_to_change_lb_grp: 8 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: max_subsystems: 128 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: monitor_timeout: 1.0 2026-02-18T03:35:59.215 INFO:journalctl@ceph.mon.a.trial034.stdout: notifications_interval: 60 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: omap_file_lock_duration: 20 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: omap_file_lock_on_read: true 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: omap_file_lock_retries: 30 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: omap_file_lock_retry_sleep_interval: 1.0 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: omap_file_update_reloads: 10 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: pool: mypool 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: port: 5500 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: prometheus_connection_list_cache_expiration: 60 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: prometheus_port: 10008 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: prometheus_startup_delay: 240 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: prometheus_stats_interval: 10 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: rebalance_period_sec: 7 2026-02-18T03:35:59.216 INFO:journalctl@ceph.mon.a.trial034.stdout: rpc_socket_dir: /var/tmp/ 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: rpc_socket_name: spdk.sock 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: spdk_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: spdk_ping_interval_in_seconds: 2.0 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: spdk_protocol_log_level: WARNING 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: spdk_timeout: 60.0 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: state_update_interval_sec: 5 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: state_update_notify: true 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: subsystem_cache_expiration: 5 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: tgt_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: transport_tcp_options: 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: in_capsule_data_size: 8192 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: max_io_qpairs_per_ctrlr: 7 2026-02-18T03:35:59.217 INFO:journalctl@ceph.mon.a.trial034.stdout: transports: tcp 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout: verbose_log_messages: true 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_keys: true 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_listener_ip: true 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_nqns: true 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout: ''')): Cannot place on trial177: Unknown hosts 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: pgmap v389: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 28 MiB/s wr, 3.15k op/s 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c)] 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:35:59.218 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Updating trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:35:59.219 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: pgmap v390: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 28 MiB/s wr, 3.18k op/s 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.919312] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:58.919332] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:58 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.017292] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.34:0/1820675320, rc 0 2026-02-18T03:35:59.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.017363] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.34:0/1820675320 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.34:0/1820675320' 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.028807] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.033402] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.033421] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.129000] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.34:0/2633425858, rc 0 2026-02-18T03:35:59.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.129078] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.34:0/2633425858 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.34:0/2633425858' 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.142640] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.147177] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.147200] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.222 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.223 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.224 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Removing trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Removing trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Removing trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Failed to apply nvmeof.mypool.mygroup0 spec NvmeofServiceSpec.from_json(yaml.safe_load('''service_type: nvmeof 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: service_id: mypool.mygroup0 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: service_name: nvmeof.mypool.mygroup0 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: placement: 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: hosts: 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: - trial034=nvmeof.a 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: - trial086=nvmeof.b 2026-02-18T03:35:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout: - trial155=nvmeof.c 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: - trial177=nvmeof.d 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: spec: 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: abort_discovery_on_errors: true 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: abort_on_errors: true 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: abort_on_update_error: true 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: allowed_consecutive_spdk_ping_failures: 1 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: break_update_interval_sec: 25 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: cluster_connections: 32 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: conn_retries: 10 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: discovery_bind_retries_limit: 10 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: discovery_bind_sleep_interval: 0.5 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: discovery_port: 8009 2026-02-18T03:35:59.375 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_monitor_client: true 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_prometheus_exporter: true 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: group: mygroup0 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: log_directory: /var/log/ceph/ 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: log_files_enabled: true 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: log_files_rotation_enabled: true 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: log_level: INFO 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_gws_in_grp: 16 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_hosts: 2048 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_hosts_per_namespace: 16 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_hosts_per_subsystem: 128 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_log_directory_backups: 10 2026-02-18T03:35:59.376 INFO:journalctl@ceph.mon.b.trial086.stdout: max_log_file_size_in_mb: 10 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_log_files_count: 20 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_message_length_in_mb: 4 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_namespaces: 4096 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_namespaces_per_subsystem: 512 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_namespaces_with_netmask: 1000 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_ns_to_change_lb_grp: 8 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: max_subsystems: 128 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: monitor_timeout: 1.0 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: notifications_interval: 60 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: omap_file_lock_duration: 20 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: omap_file_lock_on_read: true 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: omap_file_lock_retries: 30 2026-02-18T03:35:59.377 INFO:journalctl@ceph.mon.b.trial086.stdout: omap_file_lock_retry_sleep_interval: 1.0 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: omap_file_update_reloads: 10 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: pool: mypool 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: port: 5500 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: prometheus_connection_list_cache_expiration: 60 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: prometheus_port: 10008 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: prometheus_startup_delay: 240 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: prometheus_stats_interval: 10 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: rebalance_period_sec: 7 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: rpc_socket_dir: /var/tmp/ 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: rpc_socket_name: spdk.sock 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: spdk_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:59.378 INFO:journalctl@ceph.mon.b.trial086.stdout: spdk_ping_interval_in_seconds: 2.0 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: spdk_protocol_log_level: WARNING 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: spdk_timeout: 60.0 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: state_update_interval_sec: 5 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: state_update_notify: true 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: subsystem_cache_expiration: 5 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: tgt_path: /usr/local/bin/nvmf_tgt 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: transport_tcp_options: 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: in_capsule_data_size: 8192 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: max_io_qpairs_per_ctrlr: 7 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: transports: tcp 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: verbose_log_messages: true 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: verify_keys: true 2026-02-18T03:35:59.379 INFO:journalctl@ceph.mon.b.trial086.stdout: verify_listener_ip: true 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout: verify_nqns: true 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout: ''')): Cannot place on trial177: Unknown hosts 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: pgmap v389: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 28 MiB/s wr, 3.15k op/s 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c)] 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:35:59.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.conf 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Updating trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Updating trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: pgmap v390: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 28 MiB/s wr, 3.18k op/s 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: gateway address: 10.20.193.177 from map_addr=None spec.addr=None host_ip='10.20.193.177' 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: discovery address: 10.20.193.177 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.177' 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: Deploying daemon nvmeof.nvmeof.d on trial177 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.381 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:35:59.382 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.383 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.383 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.383 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:35:59.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:35:59 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:35:59] INFO rebalance.py:151 (2): Scale-down rebalance is ongoing for ANA group 4 current load 16 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.238911] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.34:0/1534338730, rc 0 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.238979] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.34:0/1534338730 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.34:0/1534338730' 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.251765] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:35:59.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.256258] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.256278] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.355926] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.34:0/1199842912, rc 0 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.355988] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.34:0/1199842912 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.34:0/1199842912' 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.369828] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.374486] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.374511] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.477989] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.34:0/1167059978, rc 0 2026-02-18T03:35:59.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.478061] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.34:0/1167059978 2026-02-18T03:35:59.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.34:0/1167059978' 2026-02-18T03:35:59.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.491066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:35:59.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.517278] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:35:59.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.517304] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:35:59.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.611881] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.616257] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.616279] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.709907] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.714358] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:35:59.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.714379] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.048 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.814719] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.820179] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.820204] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.932923] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:35:59] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.937572] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:35:59 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:35:59.937597] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.047075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:59] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:36:00.069 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:59] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: INFO: Setting log level to WARNING 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:35:59] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.798314] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.798361] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.912983] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.939055] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.939063] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.939074] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:35:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:35:59.939075] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:36:00.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:36:00.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:36:00.071 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.068342] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:36:00.321 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:36:00.321 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3922150373' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.322 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:36:00.323 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:36:00.324 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:36:00.324 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.324 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:36:00.325 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO discovery.py:369 (81): discovery addr: 10.20.193.86 port: 8009 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.115685] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.115725] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:36:00.326 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial086). 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial086). 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO state.py:2073 (81): Initialization is over (discovery-trial086). 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.327 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.328 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:36:00.329 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:36:00.330 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.336 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:36:00.336 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:36:00.336 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.336 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.336 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3922150373' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.337 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:00.338 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.062304] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.062329] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.170082] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.174667] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.174693] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:00.339 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.269648] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.274059] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.274082] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.340 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.581 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.582 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.441032] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.86:0/1358802474, rc 0 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.441112] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.86:0/1358802474 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.86:0/1358802474' 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.455065] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.459779] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.460017] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.460032] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.567629] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.86:0/3080032485, rc 0 2026-02-18T03:36:00.583 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.567699] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.86:0/3080032485 2026-02-18T03:36:00.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.86:0/3080032485' 2026-02-18T03:36:00.584 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.579820] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.648 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.369886] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.374311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.374338] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.473334] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.477762] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.477789] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:00.649 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.578190] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.583232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.583261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.650 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.584548] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.584571] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.684536] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.86:0/2677851639, rc 0 2026-02-18T03:36:00.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.684605] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.86:0/2677851639 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.86:0/2677851639' 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.698846] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.703304] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.703326] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.807180] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.86:0/553163797, rc 0 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.808449] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.86:0/553163797 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.86:0/553163797' 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.828628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:36:00.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.833844] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:36:00.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.833867] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:00.936 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: INFO: Setting log level to WARNING 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.666178] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.666344] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.782436] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.807901] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.807909] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.807917] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:36:00.937 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.807919] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:36:00.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:36:00.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:36:00.938 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.935863] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:36:00.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.683513] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.688092] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.688131] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.784187] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.788669] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.788698] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.885107] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:36:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.889529] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:36:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.889556] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.937119] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.86:0/3133948676, rc 0 2026-02-18T03:36:01.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.941626] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.86:0/3133948676 2026-02-18T03:36:01.099 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.86:0/3133948676' 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.953440] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.958065] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:00.958085] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.053887] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.86:0/3995457812, rc 0 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.053950] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.86:0/3995457812 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.86:0/3995457812' 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.067306] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.100 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:36:01.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.072144] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:36:01.101 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.072164] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:36:01.193 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO discovery.py:369 (78): discovery addr: 10.20.193.177 port: 8009 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.987179] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:00.987208] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial177). 2026-02-18T03:36:01.194 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial177). 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:00] INFO state.py:2073 (78): Initialization is over (discovery-trial177). 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.195 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.196 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.196 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.196 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.196 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.196 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.197 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:36:01.198 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: pgmap v391: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 21 MiB/s rd, 21 MiB/s wr, 2.62k op/s 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:36:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/35697232' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2077060934' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2424256624' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:36:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/724497752' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.994505] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:00] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.998934] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:00.998962] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.095080] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.099587] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.099613] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.196698] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.201116] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:36:01.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.201146] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: pgmap v391: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 21 MiB/s rd, 21 MiB/s wr, 2.62k op/s 2026-02-18T03:36:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:36:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:36:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/35697232' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2077060934' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2424256624' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:36:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/724497752' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.175766] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.86:0/1872123413, rc 0 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.175829] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.86:0/1872123413 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.86:0/1872123413' 2026-02-18T03:36:01.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.186620] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.191167] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.191188] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.291053] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.86:0/1734514799, rc 0 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.291620] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.86:0/1734514799 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.86:0/1734514799' 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.304544] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:36:01.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.309065] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:36:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.309085] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.450 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.301879] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.177:0/850677425, rc 0 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.301934] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.177:0/850677425 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.177:0/850677425' 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.314173] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.318918] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.319142] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.319156] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.435502] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.177:0/3868442143, rc 0 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.435552] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.177:0/3868442143 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.177:0/3868442143' 2026-02-18T03:36:01.451 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.449619] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.585 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.585 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.585 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.305771] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.585 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:36:01.585 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.310234] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.310264] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.409811] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.414236] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.414261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.513556] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.586 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:36:01.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.518061] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:36:01.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.518089] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.637 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.637 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.637 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.412587] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.86:0/3286416364, rc 0 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.412648] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.86:0/3286416364 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.86:0/3286416364' 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.425616] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.431861] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.431883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.537890] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.86:0/215909727, rc 0 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.538617] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.86:0/215909727 2026-02-18T03:36:01.638 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.86:0/215909727' 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.551628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.561622] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.561646] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.639 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:36:01.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.454947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.454969] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.563100] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.177:0/1245590083, rc 0 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.563153] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.177:0/1245590083 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.177:0/1245590083' 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.577050] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.581430] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:36:01.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.581449] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.697634] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.177:0/3775841923, rc 0 2026-02-18T03:36:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.698318] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.177:0/3775841923 2026-02-18T03:36:01.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.177:0/3775841923' 2026-02-18T03:36:01.733 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 69.30 664.4k 602.8k 0.0k 6.5M 5.9M 0.0k nvme12n3 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 64.10 576.4k 622.0k 0.0k 5.6M 6.1M 0.0k nvme16n3 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 64.10 544.0k 585.6k 0.0k 5.3M 5.7M 0.0k nvme20n3 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 65.60 593.6k 600.4k 0.0k 5.8M 5.9M 0.0k nvme24n3 2026-02-18T03:36:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 62.20 588.4k 613.6k 0.0k 5.7M 6.0M 0.0k nvme28n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 68.10 602.8k 615.6k 0.0k 5.9M 6.0M 0.0k nvme32n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 71.40 702.4k 595.2k 0.0k 6.9M 5.8M 0.0k nvme36n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 64.40 572.8k 633.2k 0.0k 5.6M 6.2M 0.0k nvme40n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 64.20 609.2k 597.2k 0.0k 5.9M 5.8M 0.0k nvme44n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 67.40 607.2k 568.8k 0.0k 5.9M 5.6M 0.0k nvme48n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 66.80 645.2k 604.8k 0.0k 6.3M 5.9M 0.0k nvme4n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 62.10 548.8k 661.6k 0.0k 5.4M 6.5M 0.0k nvme52n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 63.60 566.0k 626.8k 0.0k 5.5M 6.1M 0.0k nvme56n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 67.30 610.8k 613.2k 0.0k 6.0M 6.0M 0.0k nvme60n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 65.70 582.4k 662.8k 0.0k 5.7M 6.5M 0.0k nvme64n3 2026-02-18T03:36:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 64.60 555.2k 609.6k 0.0k 5.4M 6.0M 0.0k nvme8n3 2026-02-18T03:36:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:01.895 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.616220] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.895 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:36:01.895 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.620863] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:36:01.895 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.620891] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:01.895 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.714579] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.719195] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.719223] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.818372] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.823008] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.823035] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.897 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.897 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.665556] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.86:0/2858819587, rc 0 2026-02-18T03:36:01.897 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.665814] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.86:0/2858819587 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.86:0/2858819587' 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.679644] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.688895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.688922] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.781464] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.86:0/4030083375, rc 0 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.781530] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.86:0/4030083375 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.86:0/4030083375' 2026-02-18T03:36:01.898 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.793587] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.798192] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.798215] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.894182] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.86:0/259882520, rc 0 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.894248] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.86:0/259882520 2026-02-18T03:36:01.899 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.86:0/259882520' 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.716442] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.720961] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.720980] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.833268] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.177:0/1295491050, rc 0 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.833321] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.177:0/1295491050 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.177:0/1295491050' 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.846898] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.851404] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.851425] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.955421] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.177:0/1389579224, rc 0 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.956328] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.177:0/1389579224 2026-02-18T03:36:01.972 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.177:0/1389579224' 2026-02-18T03:36:01.973 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.970137] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.906153] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.910538] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:01.910559] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.002190] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.86:0/994749027, rc 0 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.002250] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.86:0/994749027 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.86:0/994749027' 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.014580] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.019150] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.019174] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.114963] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.86:0/2456782561, rc 0 2026-02-18T03:36:02.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.115029] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.86:0/2456782561 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.86:0/2456782561' 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.128339] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.132922] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.132942] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.926531] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.931098] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:01.931124] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.036247] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.040846] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.040875] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.131048] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.135720] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.135743] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.294 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:01] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.974899] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:01.974919] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.083107] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.177:0/2146140530, rc 0 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.083157] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.177:0/2146140530 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.177:0/2146140530' 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.094773] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:36:02.295 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.099891] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.099912] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.204169] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.177:0/3568736165, rc 0 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.204220] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.177:0/3568736165 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.177:0/3568736165' 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.215719] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.220088] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.220107] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.296 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.225077] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.86:0/19086178, rc 0 2026-02-18T03:36:02.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.225632] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.86:0/19086178 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.86:0/19086178' 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.236400] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.244606] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.244638] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.324848] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.86:0/340427017, rc 0 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.325619] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.86:0/340427017 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.86:0/340427017' 2026-02-18T03:36:02.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.336680] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.341785] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.341808] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.441660] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.86:0/1247667329, rc 0 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.441729] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.86:0/1247667329 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.86:0/1247667329' 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.453266] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:36:02.504 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.244531] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.249166] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.249188] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.336171] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.340752] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:36:02.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.340779] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.432078] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.436665] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.436687] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.327950] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.177:0/791605242, rc 0 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.328001] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.177:0/791605242 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.177:0/791605242' 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.340824] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.345326] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:36:02.549 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.345346] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.453350] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.177:0/187869436, rc 0 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.453400] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.177:0/187869436 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.177:0/187869436' 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.467221] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.471853] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.471872] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.550 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.457714] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.457735] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.553661] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.86:0/1830142883, rc 0 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.553727] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.86:0/1830142883 2026-02-18T03:36:02.755 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.86:0/1830142883' 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.567232] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.571989] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.572014] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.675678] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.86:0/1271864243, rc 0 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.675747] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.86:0/1271864243 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.86:0/1271864243' 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.688297] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:36:02.756 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.692865] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:36:02.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.692889] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:02.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.757 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.541891] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.546523] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.546551] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.649113] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.653634] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.653664] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.757665] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.580110] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.177:0/3753117052, rc 0 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.580159] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.177:0/3753117052 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.177:0/3753117052' 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.592679] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.597516] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:36:02.802 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.597539] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.709618] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.177:0/4001235167, rc 0 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.710321] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.177:0/4001235167 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.177:0/4001235167' 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.724332] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.730555] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.730577] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:02.803 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.781292] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.781321] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.916600] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.921152] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:02.921176] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:02] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:03.001000] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.34 port 4420 *** 2026-02-18T03:36:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.780852] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.86:0/1160219057, rc 0 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.780921] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.86:0/1160219057 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.86:0/1160219057' 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.791860] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:36:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.796608] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.796629] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.888614] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.86:0/2470357756, rc 0 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.888693] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.86:0/2470357756 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.86:0/2470357756' 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.901722] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.906813] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:02.906837] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.017 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.018 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.002695] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.86:0/499647115, rc 0 2026-02-18T03:36:03.018 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.002773] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.86:0/499647115 2026-02-18T03:36:03.018 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.86:0/499647115' 2026-02-18T03:36:03.018 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.014281] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.833540] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.177:0/1817094299, rc 0 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.833594] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.177:0/1817094299 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.177:0/1817094299' 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.847183] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.851585] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:36:03.054 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.851603] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.959711] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.177:0/1846521, rc 0 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.959760] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.177:0/1846521 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.177:0/1846521' 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.973321] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:02] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.977939] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:02.977957] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.055 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.269 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-mon[73228]: pgmap v392: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 17 MiB/s wr, 2.45k op/s 2026-02-18T03:36:03.269 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.018917] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.018938] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.127941] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.86:0/4081975503, rc 0 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.128629] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.86:0/4081975503 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.86:0/4081975503' 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.140621] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:36:03.270 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.160845] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.160875] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.256491] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.86:0/2910819209, rc 0 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.256553] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.86:0/2910819209 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.86:0/2910819209' 2026-02-18T03:36:03.271 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.268283] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-mon[21825]: pgmap v392: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 17 MiB/s wr, 2.45k op/s 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:36:03.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:03] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:36:03.321 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.086076] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.177:0/1284467901, rc 0 2026-02-18T03:36:03.321 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.086127] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.177:0/1284467901 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.177:0/1284467901' 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.099188] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.103724] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.103745] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.199586] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.177:0/2274097265, rc 0 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.199636] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.177:0/2274097265 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.177:0/2274097265' 2026-02-18T03:36:03.322 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.211940] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.216721] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.216740] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.320539] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.177:0/991236655, rc 0 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.320592] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.177:0/991236655 2026-02-18T03:36:03.323 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.177:0/991236655' 2026-02-18T03:36:03.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:36:03.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.272830] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:36:03.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.272852] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:03.570 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.361200] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.86:0/2186355817, rc 0 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.361279] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.86:0/2186355817 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.86:0/2186355817' 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.373628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.378440] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.378460] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.571 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.471005] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.86:0/3540295584, rc 0 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.482622] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.86:0/3540295584 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.86:0/3540295584' 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.494589] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.499532] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.499553] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.572 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.333170] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.338035] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.338056] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.573 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.442283] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.177:0/2146323229, rc 0 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.442351] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.177:0/2146323229 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.177:0/2146323229' 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.455102] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.459646] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.459665] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.555767] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.177:0/347982496, rc 0 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.555817] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.177:0/347982496 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.177:0/347982496' 2026-02-18T03:36:03.574 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.567685] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:36:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.572187] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:36:03.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.572207] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.595411] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.86:0/523942147, rc 0 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.598628] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.86:0/523942147 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.86:0/523942147' 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.609844] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:36:03.845 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.617811] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.617829] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.702115] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.86:0/204691222, rc 0 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.702186] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.86:0/204691222 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.86:0/204691222' 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.713865] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.718435] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:36:03.846 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.718455] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.806500] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.86:0/3374025570, rc 0 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.806574] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.86:0/3374025570 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.86:0/3374025570' 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.818211] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.843849] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:36:03.847 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.843880] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:03.875 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.875 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.875 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.672637] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.177:0/717492618, rc 0 2026-02-18T03:36:03.875 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.672690] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.177:0/717492618 2026-02-18T03:36:03.875 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.177:0/717492618' 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.684357] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.688926] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.688947] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.788815] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.177:0/4000888039, rc 0 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.789344] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.177:0/4000888039 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.177:0/4000888039' 2026-02-18T03:36:03.876 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.801661] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:03.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:36:03.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.806567] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:36:03.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.806588] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:03.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:03.877 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.935556] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.86:0/2518962779, rc 0 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.935621] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.86:0/2518962779 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.86:0/2518962779' 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.948458] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.953268] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:03.953289] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.041029] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.86:0/3027821916, rc 0 2026-02-18T03:36:04.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.041098] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.86:0/3027821916 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.86:0/3027821916' 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.052511] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.057496] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.057517] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.906667] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.177:0/2045159158, rc 0 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.907328] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.177:0/2045159158 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.177:0/2045159158' 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.919201] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.924233] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:36:04.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:03.924254] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.024372] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.177:0/1523003997, rc 0 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.024423] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.177:0/1523003997 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.177:0/1523003997' 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.036934] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.041453] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.041473] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.158071] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.177:0/238542338, rc 0 2026-02-18T03:36:04.161 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.158123] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.177:0/238542338 2026-02-18T03:36:04.161 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.177:0/238542338' 2026-02-18T03:36:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3327116164' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-mon[73228]: pgmap v393: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 10 MiB/s rd, 9.7 MiB/s wr, 2.13k op/s 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.151550] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.156162] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.156193] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.246830] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.252228] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.252256] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.351442] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.355908] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:36:04.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.355932] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.172136] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.176652] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.176673] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.284450] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.177:0/147343416, rc 0 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.284501] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.177:0/147343416 2026-02-18T03:36:04.411 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.177:0/147343416' 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.297135] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.301639] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.301658] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.409976] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.177:0/2233904743, rc 0 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.410031] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.177:0/2233904743 2026-02-18T03:36:04.412 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.177:0/2233904743' 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.421302] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.426180] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.426199] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.530569] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.177:0/3324276056, rc 0 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.530619] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.177:0/3324276056 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.177:0/3324276056' 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.542814] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.547761] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.547782] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.659978] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.177:0/81514597, rc 0 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.660030] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.177:0/81514597 2026-02-18T03:36:04.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.177:0/81514597' 2026-02-18T03:36:04.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.451856] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.456361] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.456383] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.555876] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.560329] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.560349] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.659622] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:36:04.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.664089] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:36:04.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.664109] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:36:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3327116164' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:04.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-mon[21825]: pgmap v393: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 10 MiB/s rd, 9.7 MiB/s wr, 2.13k op/s 2026-02-18T03:36:04.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:04] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:04.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 1 2026-02-18T03:36:04.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:55126 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.297226] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000166 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.321171] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000164 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.337136] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000144 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.353182] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000192 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.369145] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000161 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.385139] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000158 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.401146] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000167 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.425159] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000180 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.441117] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000140 seconds 2026-02-18T03:36:04.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.457133] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000159 seconds 2026-02-18T03:36:04.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.473119] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000140 seconds 2026-02-18T03:36:04.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.497135] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000153 seconds 2026-02-18T03:36:04.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:04.513140] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000162 seconds 2026-02-18T03:36:04.918 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.672321] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.918 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.676860] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.676879] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.780837] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.177:0/3529153878, rc 0 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.780888] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.177:0/3529153878 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.177:0/3529153878' 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.792867] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:36:04.919 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.797437] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.797457] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.905608] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.177:0/2255196391, rc 0 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.905657] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.177:0/2255196391 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.177:0/2255196391' 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.917421] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:04.920 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:36:05.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.759610] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:36:05.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.764084] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:36:05.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.764107] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:05.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.854886] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.859365] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.859385] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.965636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:04] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.970127] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:36:05.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:04.970148] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.171 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.922080] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:36:05.171 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:04.922100] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:05.171 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.171 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.034704] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.177:0/3156051014, rc 0 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.034754] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.177:0/3156051014 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.177:0/3156051014' 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.049667] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.054704] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.054724] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.158944] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.177:0/3614969815, rc 0 2026-02-18T03:36:05.172 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.159320] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.177:0/3614969815 2026-02-18T03:36:05.173 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.177:0/3614969815' 2026-02-18T03:36:05.173 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.170318] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.341 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.059849] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.064374] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.064398] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.160980] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.165421] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.165446] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:05.342 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.268337] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.272758] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.272789] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.343 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.175185] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.175208] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.287313] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.291729] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.291752] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.402575] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.407063] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:36:05.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.407087] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.591 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.371002] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.375471] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.375491] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.475629] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.480092] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.480113] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:05.592 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.593 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.590627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.513642] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.518032] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.518054] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:05.733 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.637372] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.641784] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.641805] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.734 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:36:05.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.602848] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:36:05.851 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.602871] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.720022] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.726443] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.726472] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:05.852 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.850643] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:36:05] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:58658 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.648620] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000219 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.664559] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000226 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.680527] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000191 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.696577] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000216 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.712567] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000215 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.736588] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000218 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.752613] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000232 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.768661] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000296 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.784638] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000229 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.800612] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000231 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.832621] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000218 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.848586] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000224 seconds 2026-02-18T03:36:05.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:05 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:36:05.867482] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.003108 seconds 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:05] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:06.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:55138 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.649189] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000178 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.665172] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000195 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.681139] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000161 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.697124] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000142 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.713157] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000156 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.729198] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000227 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.753119] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000137 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.769153] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000154 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.785178] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000201 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.801160] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000179 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.817170] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000184 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.856541] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000308 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.872396] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000183 seconds 2026-02-18T03:36:06.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:05 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:05.888383] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000170 seconds 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.773335] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.777791] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.777810] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.089 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.966281] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.970718] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:05.970738] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.090 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.855341] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:05.855378] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.020447] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.025009] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:36:06.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.025046] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:06.424 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.133755] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.424 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.138327] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.138347] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.309769] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.314133] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.314151] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.425 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.519 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.215616] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.220173] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.220203] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.388639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.396062] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:36:06.520 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.396092] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:06.521 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.521 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.474023] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.478456] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.478475] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.675 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.676 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.674519] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.791 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-mon[73228]: pgmap v394: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 6.4 MiB/s rd, 5.4 MiB/s wr, 2.13k op/s 2026-02-18T03:36:06.791 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1912501027' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:06.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.582168] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.791 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:36:06.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.586668] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:36:06.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.586694] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:06.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.792 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.790248] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.952 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:36:06.952 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.678942] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.678962] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.846507] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.851062] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.851081] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:06.953 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:06 trial034 ceph-mon[21825]: pgmap v394: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 6.4 MiB/s rd, 5.4 MiB/s wr, 2.13k op/s 2026-02-18T03:36:07.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1912501027' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:07.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:36:07.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.797371] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:36:07.107 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.797415] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.965648] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.991976] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:06.992039] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.108 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:06.999404] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:06] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:36:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.003817] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:36:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.003838] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:07.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.149221] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:36:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.153620] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:36:07.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.153639] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.145628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:36:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.157412] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:36:07.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.157459] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.314957] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.326493] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:36:07.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.326524] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:07.590 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.590 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.328366] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.332822] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.332843] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.490057] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.494456] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.494479] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:07.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.546729] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.555396] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:36:07.822 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.555439] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.709948] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.714870] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.714916] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.823 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.882 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.631416] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.635892] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.635914] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.772179] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.776720] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:36:07.883 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.776742] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:07.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:07.884 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.870904] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:36:08.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.875430] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:36:08.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:07.875462] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:07 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:07] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.042430] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.049071] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:36:08.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.049107] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.935000] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:07] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.939604] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:07 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:07.939625] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.152 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.151425] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:36:07.981554] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:36:08.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:36:08.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.155965] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:36:08.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.155987] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:08.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.308283] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.313120] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.313140] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.215630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.227990] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.228027] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.386484] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:36:08.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.393260] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:36:08.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.393299] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:08.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.481792] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:36:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.486304] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:36:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.486324] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:08.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.662905] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:36:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.667343] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:36:08.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.667363] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:08.751 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-mon[73228]: pgmap v395: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 5.7 MiB/s rd, 4.1 MiB/s wr, 2.35k op/s 2026-02-18T03:36:08.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.553651] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.558330] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.558359] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:08.674179] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.86 port 4420 *** 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.752 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:08.753 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:08 trial034 ceph-mon[21825]: pgmap v395: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 5.7 MiB/s rd, 4.1 MiB/s wr, 2.35k op/s 2026-02-18T03:36:09.091 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.841681] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.846059] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.846079] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.994707] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.092 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:08] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:36:09.093 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.999131] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:36:09.093 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:08 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:08.999151] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:09.093 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.093 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:36:09.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:08 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:08] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.147712] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.152079] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.152097] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.375 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.375114] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.384321] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.384350] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.546301] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:36:09.659 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.550843] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:36:09.660 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.550863] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:36:09.660 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.660 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.711382] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:36:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.715863] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:36:09.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.715883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.875566] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:09] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.880793] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:36:09.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:09 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:09.880811] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:36:10.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3018558444' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:10.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3018558444' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:10.331 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.044290] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.048736] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.048755] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.215403] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:36:10.332 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.219899] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:36:10.333 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.219918] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:36:10.333 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:36:10.333 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.373370] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.377799] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.377819] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.591 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:10.497625] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.177 port 4420 *** 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.592 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.593 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.594 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.966 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.967 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.968 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.969 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:36:10.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:10] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:36:11.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:10 trial034 ceph-mon[21825]: pgmap v396: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 6.6 MiB/s rd, 4.9 MiB/s wr, 2.45k op/s 2026-02-18T03:36:11.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1460130311' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:11.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:10 trial086 ceph-mon[73228]: pgmap v396: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 6.6 MiB/s rd, 4.9 MiB/s wr, 2.45k op/s 2026-02-18T03:36:11.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:10 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1460130311' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:11.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:11.735 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 113.50 934.4k 1.1M 0.0k 9.1M 10.7M 0.0k nvme12n3 2026-02-18T03:36:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 117.90 1023.2k 1.0M 0.0k 10.0M 10.2M 0.0k nvme16n3 2026-02-18T03:36:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 124.80 1.2M 1.1M 0.0k 11.6M 10.5M 0.0k nvme20n3 2026-02-18T03:36:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 115.00 1.1M 1.0M 0.0k 11.0M 10.2M 0.0k nvme24n3 2026-02-18T03:36:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 112.40 1.0M 1.0M 0.0k 10.1M 10.4M 0.0k nvme28n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 124.30 2.2M 2.1M 0.0k 21.6M 20.7M 0.0k nvme32n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 118.90 1.1M 1.0M 0.0k 10.6M 10.5M 0.0k nvme36n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 119.50 1.1M 1.0M 0.0k 11.1M 10.3M 0.0k nvme40n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 114.70 1.0M 997.2k 0.0k 10.1M 9.7M 0.0k nvme44n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 121.20 1.5M 1.3M 0.0k 15.1M 13.4M 0.0k nvme48n3 2026-02-18T03:36:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 117.90 1.1M 1019.2k 0.0k 10.8M 10.0M 0.0k nvme4n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 113.00 1.1M 1017.6k 0.0k 10.7M 9.9M 0.0k nvme52n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 116.00 1.1M 1013.2k 0.0k 10.6M 9.9M 0.0k nvme56n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 111.20 959.6k 967.6k 0.0k 9.4M 9.4M 0.0k nvme60n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 112.70 1.0M 1006.0k 0.0k 10.3M 9.8M 0.0k nvme64n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 109.90 1023.6k 1.0M 0.0k 10.0M 10.3M 0.0k nvme8n3 2026-02-18T03:36:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:11.922 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2329716393' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:11.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:36:11] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:11.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:11.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:11.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:11.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:36:11.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:36:11.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:36:11.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:36:11.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:39618 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:36:11] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:11.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:36:11.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:50304 2026-02-18T03:36:12.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:11 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2329716393' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:13.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:12 trial034 ceph-mon[21825]: pgmap v397: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 9.0 MiB/s wr, 3.02k op/s 2026-02-18T03:36:13.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:12 trial086 ceph-mon[73228]: pgmap v397: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 9.0 MiB/s wr, 3.02k op/s 2026-02-18T03:36:14.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/880043166' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:14.117 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/880043166' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:14.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.116977] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:36:15.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:14 trial034 ceph-mon[21825]: pgmap v398: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 13 MiB/s wr, 3.33k op/s 2026-02-18T03:36:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-mon[73228]: pgmap v398: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 13 MiB/s wr, 3.33k op/s 2026-02-18T03:36:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:36:14] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:15.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:15.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: states { 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: grp_id: 2 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: state: OPTIMIZED 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: } 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: ], , client address: IPv4 10.20.193.86:33126 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.678944] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000168 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.694890] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000166 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.710869] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000141 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.726883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000143 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.742884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000152 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.758865] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000137 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.782866] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000131 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.798884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000155 seconds 2026-02-18T03:36:15.128 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.814876] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000146 seconds 2026-02-18T03:36:15.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.830904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000167 seconds 2026-02-18T03:36:15.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.862871] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000135 seconds 2026-02-18T03:36:15.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.878867] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000134 seconds 2026-02-18T03:36:15.129 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.894857] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000119 seconds 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.656778] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:36:15] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.912 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.913 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: states { 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: grp_id: 4 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: state: OPTIMIZED 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: } 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: ], , client address: IPv4 10.20.193.177:56290 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.677346] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000175 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.697331] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000202 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.717368] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000185 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.735371] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000165 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.751377] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000181 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.767369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000175 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.783355] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000161 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.799372] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000178 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.815369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000178 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.831475] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000279 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.847451] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000251 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.871452] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000251 seconds 2026-02-18T03:36:15.914 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.911477] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000261 seconds 2026-02-18T03:36:16.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.927609] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000390 seconds 2026-02-18T03:36:17.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:16 trial034 ceph-mon[21825]: pgmap v399: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 16 MiB/s rd, 15 MiB/s wr, 3.04k op/s 2026-02-18T03:36:17.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2886450173' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:16 trial086 ceph-mon[73228]: pgmap v399: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 16 MiB/s rd, 15 MiB/s wr, 3.04k op/s 2026-02-18T03:36:17.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2886450173' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:18.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2961848820' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:18.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:17 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2961848820' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:19.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:18 trial034 ceph-mon[21825]: pgmap v400: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 16 MiB/s wr, 2.76k op/s 2026-02-18T03:36:19.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2176088670' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:18 trial086 ceph-mon[73228]: pgmap v400: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 16 MiB/s wr, 2.76k op/s 2026-02-18T03:36:19.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:18 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2176088670' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:20 trial034 ceph-mon[21825]: pgmap v401: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.49k op/s 2026-02-18T03:36:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1941494853' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:20 trial086 ceph-mon[73228]: pgmap v401: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.49k op/s 2026-02-18T03:36:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1941494853' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:21.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 130.00 1.1M 1.1M 0.0k 11.5M 10.7M 0.0k nvme12n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 127.80 1.8M 1.6M 0.0k 17.6M 16.5M 0.0k nvme16n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 121.40 1.7M 1.8M 0.0k 17.0M 17.6M 0.0k nvme20n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 120.60 1.0M 1.1M 0.0k 10.2M 11.0M 0.0k nvme24n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 124.60 1.4M 1.4M 0.0k 13.8M 14.2M 0.0k nvme28n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 118.20 1.8M 2.0M 0.0k 18.4M 20.0M 0.0k nvme32n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 119.20 1.6M 1.6M 0.0k 15.6M 16.1M 0.0k nvme36n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 122.50 1.5M 1.5M 0.0k 15.0M 15.3M 0.0k nvme40n3 2026-02-18T03:36:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 124.50 1.6M 1.5M 0.0k 15.6M 14.6M 0.0k nvme44n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 120.00 1.9M 2.0M 0.0k 19.4M 19.9M 0.0k nvme48n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 131.50 1.4M 1.3M 0.0k 13.7M 12.8M 0.0k nvme4n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 123.30 1.1M 1.2M 0.0k 10.6M 11.5M 0.0k nvme52n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 121.10 1.1M 1.1M 0.0k 10.7M 11.2M 0.0k nvme56n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 132.00 1.3M 1.2M 0.0k 13.1M 12.4M 0.0k nvme60n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 119.10 1.1M 1.1M 0.0k 10.6M 10.7M 0.0k nvme64n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 126.40 1.7M 1.5M 0.0k 16.9M 15.0M 0.0k nvme8n3 2026-02-18T03:36:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:22 trial034 ceph-mon[21825]: pgmap v402: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 2.57k op/s 2026-02-18T03:36:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:22 trial086 ceph-mon[73228]: pgmap v402: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 2.57k op/s 2026-02-18T03:36:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1758224855' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:23 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1758224855' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:25.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:24 trial034 ceph-mon[21825]: pgmap v403: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 25 MiB/s wr, 2.39k op/s 2026-02-18T03:36:25.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:24 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2471039754' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:24 trial086 ceph-mon[73228]: pgmap v403: 33 pgs: 33 active+clean; 16 GiB data, 42 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 25 MiB/s wr, 2.39k op/s 2026-02-18T03:36:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:24 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2471039754' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:26.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:25 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/327330768' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:25 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/327330768' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:26 trial034 ceph-mon[21825]: pgmap v404: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 27 MiB/s wr, 2.29k op/s 2026-02-18T03:36:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:26 trial086 ceph-mon[73228]: pgmap v404: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 27 MiB/s wr, 2.29k op/s 2026-02-18T03:36:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4270631136' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:27 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4270631136' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:28 trial034 ceph-mon[21825]: pgmap v405: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 35 MiB/s wr, 2.73k op/s 2026-02-18T03:36:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:28 trial086 ceph-mon[73228]: pgmap v405: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 35 MiB/s wr, 2.73k op/s 2026-02-18T03:36:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:30 trial034 ceph-mon[21825]: pgmap v406: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.10k op/s 2026-02-18T03:36:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2095400904' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:30 trial086 ceph-mon[73228]: pgmap v406: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.10k op/s 2026-02-18T03:36:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:30 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2095400904' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:31.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 211.50 3.2M 3.2M 0.0k 31.8M 31.7M 0.0k nvme12n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 3.3M 3.2M 0.0k 33.1M 31.8M 0.0k nvme16n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.30 3.5M 3.4M 0.0k 34.7M 34.0M 0.0k nvme20n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 223.50 3.5M 3.0M 0.0k 35.4M 29.9M 0.0k nvme24n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 3.4M 3.2M 0.0k 33.6M 32.3M 0.0k nvme28n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 207.30 3.2M 3.1M 0.0k 32.4M 31.5M 0.0k nvme32n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 3.2M 3.2M 0.0k 32.2M 32.0M 0.0k nvme36n3 2026-02-18T03:36:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 3.2M 3.3M 0.0k 31.8M 32.7M 0.0k nvme40n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 3.2M 3.2M 0.0k 31.9M 32.4M 0.0k nvme44n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 3.1M 3.3M 0.0k 31.3M 33.5M 0.0k nvme48n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 3.0M 3.2M 0.0k 30.2M 32.4M 0.0k nvme4n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 212.30 3.0M 3.0M 0.0k 30.1M 30.1M 0.0k nvme52n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.30 3.3M 3.2M 0.0k 32.6M 32.0M 0.0k nvme56n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 3.1M 3.2M 0.0k 30.9M 32.1M 0.0k nvme60n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.20 2.6M 2.6M 0.0k 25.5M 26.4M 0.0k nvme64n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 3.3M 3.2M 0.0k 32.5M 32.4M 0.0k nvme8n3 2026-02-18T03:36:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:32.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:31 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2979612590' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:31 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2979612590' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:32 trial034 ceph-mon[21825]: pgmap v407: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.43k op/s 2026-02-18T03:36:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:32 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1366880565' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:33.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:32 trial086 ceph-mon[73228]: pgmap v407: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.43k op/s 2026-02-18T03:36:33.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:32 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1366880565' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:34 trial034 ceph-mon[21825]: pgmap v408: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.43k op/s 2026-02-18T03:36:35.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2453760285' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:34 trial086 ceph-mon[73228]: pgmap v408: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.43k op/s 2026-02-18T03:36:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2453760285' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:36 trial034 ceph-mon[21825]: pgmap v409: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.21k op/s 2026-02-18T03:36:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:36 trial086 ceph-mon[73228]: pgmap v409: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.21k op/s 2026-02-18T03:36:38.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1944667459' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:37 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1944667459' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:38 trial034 ceph-mon[21825]: pgmap v410: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.31k op/s 2026-02-18T03:36:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/539092203' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:38 trial086 ceph-mon[73228]: pgmap v410: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.31k op/s 2026-02-18T03:36:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:38 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/539092203' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:40.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2161067117' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:39 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2161067117' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:41.172 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:40 trial034 ceph-mon[21825]: pgmap v411: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.24k op/s 2026-02-18T03:36:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:40 trial086 ceph-mon[73228]: pgmap v411: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.24k op/s 2026-02-18T03:36:41.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:41.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 3.1M 3.1M 0.0k 31.5M 31.2M 0.0k nvme12n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 3.1M 3.1M 0.0k 30.9M 31.2M 0.0k nvme16n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.00 3.2M 3.1M 0.0k 32.3M 31.1M 0.0k nvme20n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 3.2M 3.2M 0.0k 32.4M 31.7M 0.0k nvme24n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 3.1M 3.1M 0.0k 30.6M 31.0M 0.0k nvme28n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 3.0M 3.0M 0.0k 30.1M 30.3M 0.0k nvme32n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.90 3.2M 3.3M 0.0k 31.5M 32.8M 0.0k nvme36n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 3.2M 3.1M 0.0k 32.1M 30.9M 0.0k nvme40n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 3.1M 3.1M 0.0k 31.5M 31.2M 0.0k nvme44n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.80 3.2M 3.1M 0.0k 32.0M 30.7M 0.0k nvme48n3 2026-02-18T03:36:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.40 3.0M 3.2M 0.0k 30.5M 31.7M 0.0k nvme4n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 3.0M 3.3M 0.0k 29.5M 32.7M 0.0k nvme52n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 3.1M 3.1M 0.0k 31.0M 30.9M 0.0k nvme56n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 3.3M 3.2M 0.0k 32.6M 31.7M 0.0k nvme60n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 3.1M 3.2M 0.0k 31.1M 31.8M 0.0k nvme64n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 3.2M 3.2M 0.0k 32.5M 31.8M 0.0k nvme8n3 2026-02-18T03:36:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:42.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2367936734' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:41 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2367936734' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:43.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:42 trial034 ceph-mon[21825]: pgmap v412: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.34k op/s 2026-02-18T03:36:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:42 trial086 ceph-mon[73228]: pgmap v412: 33 pgs: 33 active+clean; 16 GiB data, 43 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.34k op/s 2026-02-18T03:36:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:44 trial034 ceph-mon[21825]: pgmap v413: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.37k op/s 2026-02-18T03:36:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1176116041' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:44 trial086 ceph-mon[73228]: pgmap v413: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.37k op/s 2026-02-18T03:36:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1176116041' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:46.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3001718063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:45 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3001718063' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:46 trial034 ceph-mon[21825]: pgmap v414: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.16k op/s 2026-02-18T03:36:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:46 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/12880014' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:46 trial086 ceph-mon[73228]: pgmap v414: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.16k op/s 2026-02-18T03:36:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:46 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/12880014' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:48 trial034 ceph-mon[21825]: pgmap v415: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.29k op/s 2026-02-18T03:36:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3601757356' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:48 trial086 ceph-mon[73228]: pgmap v415: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 51 MiB/s wr, 3.29k op/s 2026-02-18T03:36:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:48 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3601757356' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:50 trial034 ceph-mon[21825]: pgmap v416: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.24k op/s 2026-02-18T03:36:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:50 trial086 ceph-mon[73228]: pgmap v416: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.24k op/s 2026-02-18T03:36:51.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:51.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 3.1M 3.2M 0.0k 31.2M 31.6M 0.0k nvme12n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 3.0M 3.1M 0.0k 29.8M 30.7M 0.0k nvme16n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 2.9M 2.9M 0.0k 28.7M 29.3M 0.0k nvme20n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 3.0M 3.0M 0.0k 30.5M 30.5M 0.0k nvme24n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 3.1M 2.9M 0.0k 30.6M 29.5M 0.0k nvme28n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 3.0M 3.0M 0.0k 29.9M 29.6M 0.0k nvme32n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 3.2M 3.0M 0.0k 31.6M 30.3M 0.0k nvme36n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 3.1M 3.1M 0.0k 30.9M 30.9M 0.0k nvme40n3 2026-02-18T03:36:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.9M 2.9M 0.0k 28.7M 29.2M 0.0k nvme44n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 2.9M 3.0M 0.0k 29.5M 29.8M 0.0k nvme48n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.00 3.1M 3.1M 0.0k 31.2M 30.7M 0.0k nvme4n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 3.2M 3.0M 0.0k 32.2M 30.5M 0.0k nvme52n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.30 3.2M 3.0M 0.0k 32.0M 30.1M 0.0k nvme56n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 3.0M 3.0M 0.0k 30.4M 30.4M 0.0k nvme60n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 3.2M 3.1M 0.0k 32.3M 30.9M 0.0k nvme64n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.9M 3.1M 0.0k 28.9M 30.5M 0.0k nvme8n3 2026-02-18T03:36:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:36:52.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:51 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1264645797' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:51 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1264645797' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:52.747 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:36:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:52 trial034 ceph-mon[21825]: pgmap v417: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.36k op/s 2026-02-18T03:36:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2485636014' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:52 trial086 ceph-mon[73228]: pgmap v417: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.36k op/s 2026-02-18T03:36:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:52 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2485636014' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:54.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2113514084' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:53 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2113514084' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:54 trial034 ceph-mon[21825]: pgmap v418: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.39k op/s 2026-02-18T03:36:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:54 trial086 ceph-mon[73228]: pgmap v418: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.39k op/s 2026-02-18T03:36:56.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:55 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1252102522' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:55 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1252102522' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:56 trial034 ceph-mon[21825]: pgmap v419: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.17k op/s 2026-02-18T03:36:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:56 trial086 ceph-mon[73228]: pgmap v419: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.17k op/s 2026-02-18T03:36:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:58 trial034 ceph-mon[21825]: pgmap v420: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.31k op/s 2026-02-18T03:36:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:58 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1205565389' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:36:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:58 trial086 ceph-mon[73228]: pgmap v420: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.31k op/s 2026-02-18T03:36:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:58 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1205565389' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:36:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/200058971' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:36:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/200058971' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: pgmap v421: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.27k op/s 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/129215362' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:37:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:37:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:01.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:00 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:37:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: pgmap v421: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 48 MiB/s wr, 3.27k op/s 2026-02-18T03:37:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:37:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/129215362' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:00 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:37:01.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.9M 3.0M 0.0k 28.8M 30.0M 0.0k nvme12n3 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 3.0M 2.9M 0.0k 29.9M 29.0M 0.0k nvme16n3 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.9M 2.9M 0.0k 29.3M 28.7M 0.0k nvme20n3 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 2.7M 3.0M 0.0k 26.9M 30.3M 0.0k nvme24n3 2026-02-18T03:37:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.00 2.8M 3.0M 0.0k 28.3M 29.8M 0.0k nvme28n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.7M 2.9M 0.0k 27.3M 29.3M 0.0k nvme32n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 2.8M 2.8M 0.0k 28.2M 28.0M 0.0k nvme36n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.80 3.1M 3.1M 0.0k 31.5M 31.2M 0.0k nvme40n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 3.0M 2.9M 0.0k 29.7M 28.8M 0.0k nvme44n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 2.9M 2.9M 0.0k 29.1M 28.9M 0.0k nvme48n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.8M 3.0M 0.0k 27.8M 29.5M 0.0k nvme4n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 3.0M 3.0M 0.0k 29.7M 29.7M 0.0k nvme52n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.9M 3.0M 0.0k 29.5M 29.6M 0.0k nvme56n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.9M 2.9M 0.0k 29.5M 28.8M 0.0k nvme60n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.9M 3.1M 0.0k 29.4M 31.2M 0.0k nvme64n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.8M 2.9M 0.0k 28.0M 28.9M 0.0k nvme8n3 2026-02-18T03:37:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:01 trial034 ceph-mon[21825]: Adjusting osd_memory_target on trial155 to 28015M 2026-02-18T03:37:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:01 trial086 ceph-mon[73228]: Adjusting osd_memory_target on trial155 to 28015M 2026-02-18T03:37:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:02 trial034 ceph-mon[21825]: pgmap v422: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.35k op/s 2026-02-18T03:37:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4045334233' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:03.273 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:02 trial086 ceph-mon[73228]: pgmap v422: 33 pgs: 33 active+clean; 16 GiB data, 44 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.35k op/s 2026-02-18T03:37:03.273 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:02 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4045334233' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:04 trial034 ceph-mon[21825]: pgmap v423: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.35k op/s 2026-02-18T03:37:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:04 trial086 ceph-mon[73228]: pgmap v423: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.35k op/s 2026-02-18T03:37:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2583056373' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:05 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2583056373' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:06 trial034 ceph-mon[21825]: pgmap v424: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.15k op/s 2026-02-18T03:37:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3567669572' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:06 trial086 ceph-mon[73228]: pgmap v424: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.15k op/s 2026-02-18T03:37:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:06 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3567669572' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:08.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/63103568' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:07 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/63103568' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:08.817 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #3: thrashed- nvmeof.a, nvmeof.b, nvmeof.d (by daemon_remove); 2026-02-18T03:37:08.818 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:37:08.818 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 1min 16s ago 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 317.6M (peak: 320.7M) 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 4min 57.449s 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:37:08.852 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:37:08.853 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:39618 2026-02-18T03:37:08.853 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:35:56 UTC; 1min 12s ago 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86275 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86276 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 86357 (conmon) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 323.0M (peak: 325.4M) 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 4min 38.394s 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86359 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86361 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86453 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86833 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: │ └─86861 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: └─86357 /usr/bin/conmon --api-version 1 -c c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 -u c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata -p /run/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.726883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000143 seconds 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.742884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000152 seconds 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.758865] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000137 seconds 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.782866] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000131 seconds 2026-02-18T03:37:08.886 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.798884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000155 seconds 2026-02-18T03:37:08.887 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.814876] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000146 seconds 2026-02-18T03:37:08.887 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.830904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000167 seconds 2026-02-18T03:37:08.887 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.862871] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000135 seconds 2026-02-18T03:37:08.887 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.878867] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000134 seconds 2026-02-18T03:37:08.887 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.894857] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000119 seconds 2026-02-18T03:37:08.888 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:37:08.919 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 2min 58s ago 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 352.7M (peak: 355.4M) 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 11min 42.859s 2026-02-18T03:37:08.920 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:37:08.921 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:37:08.922 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:50304 2026-02-18T03:37:08.923 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:35:58 UTC; 1min 10s ago 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51439 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51440 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 51517 (conmon) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 335.6M (peak: 338.6M) 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 4min 43.510s 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51519 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51521 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.956 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51613 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51819 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout: │ └─51824 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout: └─51517 /usr/bin/conmon --api-version 1 -c aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f -u aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata -p /run/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.751377] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000181 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.767369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000175 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.783355] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000161 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.799372] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000178 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.815369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000178 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.831475] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000279 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.847451] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000251 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.871452] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000251 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.911477] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000261 seconds 2026-02-18T03:37:08.957 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.927609] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000390 seconds 2026-02-18T03:37:08.959 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:37:09.182 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:37:09.182 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 75s ago 12m trial034=x;count:1 2026-02-18T03:37:09.182 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 2m ago 12m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:37:09.182 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 2m ago 10m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:37:09.182 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 2m ago 11m trial155 2026-02-18T03:37:09.191 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:37:09.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:08 trial034 ceph-mon[21825]: pgmap v425: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:37:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:08 trial086 ceph-mon[73228]: pgmap v425: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:37:09.374 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:37:09.374 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (76s) 75s ago 76s 54.2M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:37:09.375 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (72s) 72s ago 72s 57.1M - 1.6.5 99a57256b38c c572dc4418fe 2026-02-18T03:37:09.375 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (2m) 2m ago 7m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:37:09.375 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (71s) 70s ago 70s 54.2M - 1.6.5 99a57256b38c aafd1145cff6 2026-02-18T03:37:09.383 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:37:09.610 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:37:09.610 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:37:09.610 INFO:teuthology.orchestra.run.trial177.stdout: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:37:09.620 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:37:09.841 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,b 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,b (age 77s) [leader: a], out of quorum: c 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 12m) 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 10m), 8 in (since 11m) 2026-02-18T03:37:09.842 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: usage: 45 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: client: 45 MiB/s rd, 47 MiB/s wr, 1.62k op/s rd, 1.65k op/s wr 2026-02-18T03:37:09.843 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:37:09.850 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 171, 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 2, 2026-02-18T03:37:10.084 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 80, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:37:10.085 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:37:10.086 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:37:10.087 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:37:10.088 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:37:10.093 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:37:10.151 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:37:10.151 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:37:10.151 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:37:10.151 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.152 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.153 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.154 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.155 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.156 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.157 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.157 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.157 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.157 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:37:10.158 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:37:10.204 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.206 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:37:10.250 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.252 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:37:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1160269218' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:10.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4085537843' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:37:10.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1875961327' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:37:10.297 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.297 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:37:10.342 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.342 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:37:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1160269218' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4085537843' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:37:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1875961327' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:37:10.387 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.388 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:37:10.433 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.433 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:37:10.477 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.479 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:37:10.524 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.525 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:37:10.568 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.569 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:37:10.653 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.654 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:37:10.739 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.740 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:37:10.786 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.787 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:37:10.832 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.833 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:37:10.878 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.879 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:37:10.923 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.925 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:37:10.969 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:10.970 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:37:11.054 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.056 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:37:11.101 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.102 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:37:11.146 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.148 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:37:11.191 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.193 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:37:11.237 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.238 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:37:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:10 trial034 ceph-mon[21825]: from='client.75704 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:10 trial034 ceph-mon[21825]: from='client.61044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:10 trial034 ceph-mon[21825]: pgmap v426: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.22k op/s 2026-02-18T03:37:11.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3299813934' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:37:11.282 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.283 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:37:11.328 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.329 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:37:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:10 trial086 ceph-mon[73228]: from='client.75704 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:10 trial086 ceph-mon[73228]: from='client.61044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:10 trial086 ceph-mon[73228]: pgmap v426: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.22k op/s 2026-02-18T03:37:11.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:10 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3299813934' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:37:11.374 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.375 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:37:11.418 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.420 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:37:11.504 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.505 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:37:11.549 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.550 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:37:11.595 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.596 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:37:11.640 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.641 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:37:11.686 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.687 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:37:11.731 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.733 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.6M 2.8M 0.0k 26.3M 27.9M 0.0k nvme12n3 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.8M 2.9M 0.0k 27.6M 28.6M 0.0k nvme16n3 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.7M 2.8M 0.0k 26.6M 27.6M 0.0k nvme20n3 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 3.0M 2.9M 0.0k 29.5M 28.8M 0.0k nvme24n3 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.9M 2.8M 0.0k 29.2M 28.3M 0.0k nvme28n3 2026-02-18T03:37:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 2.6M 2.7M 0.0k 26.4M 27.4M 0.0k nvme32n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.9M 2.8M 0.0k 28.9M 28.1M 0.0k nvme36n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.8M 2.9M 0.0k 28.0M 29.3M 0.0k nvme40n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.8M 2.9M 0.0k 28.2M 28.8M 0.0k nvme44n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 2.7M 2.8M 0.0k 27.1M 27.9M 0.0k nvme48n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.50 3.0M 2.9M 0.0k 30.4M 28.5M 0.0k nvme4n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 3.0M 2.8M 0.0k 29.7M 28.2M 0.0k nvme52n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.8M 2.8M 0.0k 28.3M 28.3M 0.0k nvme56n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.20 2.6M 2.9M 0.0k 26.1M 29.3M 0.0k nvme60n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.9M 2.9M 0.0k 29.1M 29.3M 0.0k nvme64n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.7M 2.8M 0.0k 27.2M 27.9M 0.0k nvme8n3 2026-02-18T03:37:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:11.777 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.778 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:37:11.823 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.824 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:37:11.868 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.869 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:37:11.953 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:11.955 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:37:12.000 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.001 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:37:12.046 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.047 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:37:12.092 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.093 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:37:12.137 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.139 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:37:12.184 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.185 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:37:12.230 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.231 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:37:12.276 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.277 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:37:12.321 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.322 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:37:12.366 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.367 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:37:12.453 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.453 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:37:12.498 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.498 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:37:12.543 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.545 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:37:12.589 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.590 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:37:12.634 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.635 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:37:12.679 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.681 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:37:12.725 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.726 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:37:12.811 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.812 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:37:12.856 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.857 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:37:12.902 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.903 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:37:12.947 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.948 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:37:12.993 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:12.994 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:37:13.038 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.039 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:37:13.085 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.086 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:37:13.130 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.131 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:37:13.175 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.176 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:37:13.220 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.221 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:37:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:12 trial034 ceph-mon[21825]: pgmap v427: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.30k op/s 2026-02-18T03:37:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:12 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3449373356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:13.306 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.307 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:37:13.351 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.353 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:37:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:12 trial086 ceph-mon[73228]: pgmap v427: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.30k op/s 2026-02-18T03:37:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:12 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3449373356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:13.397 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:37:13.398 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:37:13.398 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:37:13.398 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.a 2026-02-18T03:37:13.398 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon start nvmeof.nvmeof.a 2026-02-18T03:37:13.399 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:37:13.399 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.c 2026-02-18T03:37:13.399 INFO:tasks.cephadm.mon.c:Restarting mon.c (starting--it wasn't running)... 2026-02-18T03:37:13.399 DEBUG:teuthology.orchestra.run.trial155:mon.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service 2026-02-18T03:37:13.402 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:37:13.608 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to start nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:37:13.618 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.b 2026-02-18T03:37:13.619 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon start nvmeof.nvmeof.b 2026-02-18T03:37:13.625 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:37:13.626 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:37:13.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 systemd[1]: Starting Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:37:13.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 podman[87895]: 2026-02-18 03:37:13.580277187 +0000 UTC m=+0.021788365 container create 725fe8150345fbc9f794b17c44076bc9ae476de4133ec3518c27f49ab63be665 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2) 2026-02-18T03:37:13.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 podman[87895]: 2026-02-18 03:37:13.612790151 +0000 UTC m=+0.054301349 container init 725fe8150345fbc9f794b17c44076bc9ae476de4133ec3518c27f49ab63be665 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:37:13.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 podman[87895]: 2026-02-18 03:37:13.615695153 +0000 UTC m=+0.057206331 container start 725fe8150345fbc9f794b17c44076bc9ae476de4133ec3518c27f49ab63be665 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216) 2026-02-18T03:37:13.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 bash[87895]: 725fe8150345fbc9f794b17c44076bc9ae476de4133ec3518c27f49ab63be665 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 podman[87895]: 2026-02-18 03:37:13.573470447 +0000 UTC m=+0.014981645 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 systemd[1]: Started Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pidfile_write: ignore empty --pid-file 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: load: jerasure load: lrc 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Git sha 0 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: DB SUMMARY 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: DB Session ID: FOFUP0OFCMD1ZH586MJT 2026-02-18T03:37:13.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: MANIFEST file: MANIFEST-000026 size: 533 Bytes 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000031.sst 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000029.log size: 2672303 ; 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.env: 0x563e44d6a100 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:37:13.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.info_log: 0x563e4a0a5b00 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.statistics: (nil) 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.use_fsync: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:37:13.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.db_log_dir: 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.wal_dir: 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:37:13.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.write_buffer_manager: 0x563e4a0a8b40 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.unordered_write: 0 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:37:13.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.row_cache: None 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.wal_filter: None 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.wal_compression: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:37:13.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:37:13.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:37:13.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_open_files: -1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Compression algorithms supported: 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kZSTD supported: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000026 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.merge_operator: 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_filter: None 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563e4a0a4240) 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: index_type: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_index_type: 0 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: index_shortening: 1 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: checksum: 4 2026-02-18T03:37:13.738 INFO:journalctl@ceph.mon.c.trial155.stdout: no_block_cache: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache: 0x563e4a0c5b90 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_options: 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: capacity : 536870912 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: num_shard_bits : 4 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: strict_capacity_limit : 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_compressed: (nil) 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: persistent_cache: (nil) 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size: 4096 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size_deviation: 10 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_restart_interval: 16 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: index_block_restart_interval: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: metadata_block_size: 4096 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: partition_filters: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: use_delta_encoding: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: filter_policy: bloomfilter 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: whole_key_filtering: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: verify_compression: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: format_version: 5 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_index_compression: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: block_align: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: max_auto_readahead_size: 262144 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: prepopulate_block_cache: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression: NoCompression 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.num_levels: 7 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:37:13.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:37:13.740 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.ttl: 2592000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000026 succeeded,manifest_file_number is 26, next_file_number is 33, last_sequence is 13445, log_number is 29,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 29 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 29 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 711ce751-a115-4d3b-ae33-6c3f58e6c51c 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385833649538, "job": 1, "event": "recovery_started", "wal_files": [29]} 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #29 mode 2 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385833655654, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 34, "file_size": 1710425, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13446, "largest_seqno": 15135, "table_properties": {"data_size": 1702904, "index_size": 4431, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2053, "raw_key_size": 16943, "raw_average_key_size": 20, "raw_value_size": 1687085, "raw_average_value_size": 2070, "num_data_blocks": 200, "num_entries": 815, "num_filter_entries": 815, "num_deletions": 254, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771385833, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "711ce751-a115-4d3b-ae33-6c3f58e6c51c", "db_session_id": "FOFUP0OFCMD1ZH586MJT", "orig_file_number": 34, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385833655723, "job": 1, "event": "recovery_finished"} 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:5047] Creating manifest 36 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000029.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563e4a0c8700 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: DB pointer 0x563e4a0da000 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: ** DB Stats ** 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:37:13.741 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: L0 1/0 1.63 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: L6 1/0 7.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Sum 2/0 8.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 575.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Flush(GB): cumulative 0.002, interval 0.002 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative compaction: 0.00 GB write, 193.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval compaction: 0.00 GB write, 193.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache BinnedLRUCache@0x563e4a0c5b90#2 capacity: 512.00 MB usage: 6.87 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.29 KB,0.000436604%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: starting mon.c rank 1 at public addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] at bind addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).mds e1 new map 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).mds e1 print_map 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: e1 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: legacy client fscid: -1 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout: No filesystems configured 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).osd e54 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).osd e54 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).osd e54 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:37:13.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).osd e54 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:37:13.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: mon.c@-1(???).paxosservice(auth 1..33) refresh upgraded, format 0 -> 3 2026-02-18T03:37:13.837 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to start nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:37:13.847 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.d 2026-02-18T03:37:13.847 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon start nvmeof.nvmeof.d 2026-02-18T03:37:13.872 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":30,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":81,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:37:14.036 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to start nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:37:14.045 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 64 secs before thrashing 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pgmap v423: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 49 MiB/s wr, 3.35k op/s 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2583056373' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pgmap v424: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.15k op/s 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3567669572' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/63103568' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pgmap v425: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1160269218' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4085537843' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1875961327' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.75704 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.61044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pgmap v426: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 46 MiB/s wr, 3.22k op/s 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3299813934' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: pgmap v427: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.30k op/s 2026-02-18T03:37:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3449373356' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:15.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='client.61074 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.a 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='client.75755 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: pgmap v428: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.34k op/s 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: mon.c calling monitor election 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: mon.a calling monitor election 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: monmap epoch 3 2026-02-18T03:37:15.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: min_mon_release 20 (tentacle) 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: election_strategy: 1 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: fsmap 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: mgrmap e15: x(active, since 12m) 2026-02-18T03:37:15.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: Cluster is now healthy 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: overall HEALTH_OK 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='client.75767 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1000665714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:14 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:37:15.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='client.61074 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: Schedule start daemon nvmeof.nvmeof.a 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='client.75755 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: pgmap v428: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.34k op/s 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: mon.c calling monitor election 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: mon.a calling monitor election 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: monmap epoch 3 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:37:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: min_mon_release 20 (tentacle) 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: election_strategy: 1 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: fsmap 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: mgrmap e15: x(active, since 12m) 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: Cluster is now healthy 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: overall HEALTH_OK 2026-02-18T03:37:15.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='client.75767 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1000665714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:14 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='client.61074 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.a 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='client.75755 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.b 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: pgmap v428: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 47 MiB/s wr, 3.34k op/s 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:37:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 12m) 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: Cluster is now healthy 2026-02-18T03:37:15.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: overall HEALTH_OK 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='client.75767 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: Schedule start daemon nvmeof.nvmeof.d 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1000665714' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:15.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:14 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:37:16.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:15 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:15 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:37:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:37:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:37:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:15 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:37:16.885 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:37:17.135 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:37:17.148 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:37:17.148 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:37:17.148 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:37:17.167 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:16 trial034 ceph-mon[21825]: pgmap v429: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:37:17.168 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1514443743' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 786649, 2026-02-18T03:37:17.225 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.226 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.227 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.228 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:37:17.229 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.230 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.231 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:37:17.232 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.233 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.234 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:37:17.235 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.236 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:37:17.237 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.238 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.239 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:37:17.240 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: "num": 84 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.241 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:37:17.242 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:37:17.243 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:16 trial155 ceph-mon[87919]: pgmap v429: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:37:17.243 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1514443743' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:17.244 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:37:17.245 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:37:17.245 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:37:17.364 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:37:17.364 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:37:17.364 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:37:17.364 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 351665, 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:17.365 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.366 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.367 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:37:17.368 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:37:17.369 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:17.370 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.371 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.372 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.373 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.374 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.375 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:37:17.376 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:37:17.377 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:17.378 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout: "num": 63 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:37:17.379 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:37:17.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:16 trial086 ceph-mon[73228]: pgmap v429: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:37:17.380 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1514443743' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:17.381 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:37:17.381 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:37:17.382 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:37:18.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:17 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/317633664' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:37:18.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:17 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:17 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:17 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:17 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/317633664' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:37:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:17 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:17 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:17 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:17 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:17 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/317633664' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:37:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:17 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:17 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:17 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:17 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:18.866 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:37:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:37:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:37:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:37:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 5207, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 4, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:37:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:37:18.870 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:37:18.876 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:37:18.876 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:37:18.876 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:37:19.136 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:18 trial034 ceph-mon[21825]: pgmap v430: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.25k op/s 2026-02-18T03:37:19.136 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:18 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:19.136 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:18 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:19.137 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:37:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:18 trial155 ceph-mon[87919]: pgmap v430: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.25k op/s 2026-02-18T03:37:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:18 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:18 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:18 trial086 ceph-mon[73228]: pgmap v430: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.25k op/s 2026-02-18T03:37:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:18 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:37:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:18 trial086 ceph-mon[73228]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:37:20.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1134783640' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:37:20.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {auth=47,config=2,health=13,kv=38} crc {auth=4253033114,config=1466402343,health=2716147082,kv=1199048720}) 2026-02-18T03:37:20.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {kv=38,logm=62} crc {kv=3196826348,logm=2466945136}) 2026-02-18T03:37:20.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3459656652}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3816521544}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3206255034}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208626193}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963378987}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=586559314}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2079522818}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1881631836}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2872285101}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2556025366}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3156046030}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2574553391}) 2026-02-18T03:37:20.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3628751713}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1228693389}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1656259098}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1050017186}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=701785473}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1358146665}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=291097520}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=521403314}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734530399}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1178916480}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2667721244}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3635101155}) 2026-02-18T03:37:20.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2585623107}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2494962704}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3495910434}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1889327265}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2254907229}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4102935371}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=751274390}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2986584997}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405454811}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=9,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=68} crc {logm=710779075,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2787385243}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=35,mon_config_key=65} crc {mgrstat=877508999,mon_config_key=606033506}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=412218876}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=54,monmap=5,nvmeofgw=41} crc {mon_config_key=2684908918,monmap=1407976167,nvmeofgw=2319831493}) 2026-02-18T03:37:20.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1091869665}) 2026-02-18T03:37:20.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=34,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=55} crc {nvmeofgw=232830012,osd_metadata=2727074769,osd_pg_creating=2382909690,osd_snap=3842414688,osdmap=4174950277}) 2026-02-18T03:37:20.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=58} crc {osdmap=998182440}) 2026-02-18T03:37:20.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:19 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3948878876' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1134783640' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {auth=47,config=2,health=13,kv=38} crc {auth=4253033114,config=1466402343,health=2716147082,kv=1199048720}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=38,logm=62} crc {kv=3196826348,logm=2466945136}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3459656652}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3816521544}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3206255034}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208626193}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963378987}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=586559314}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2079522818}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1881631836}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2872285101}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2556025366}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3156046030}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2574553391}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3628751713}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1228693389}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1656259098}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1050017186}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=701785473}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1358146665}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=291097520}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=521403314}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734530399}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1178916480}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2667721244}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3635101155}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2585623107}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2494962704}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3495910434}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1889327265}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2254907229}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4102935371}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=751274390}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2986584997}) 2026-02-18T03:37:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405454811}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=9,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=68} crc {logm=710779075,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2787385243}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=35,mon_config_key=65} crc {mgrstat=877508999,mon_config_key=606033506}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=412218876}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=54,monmap=5,nvmeofgw=41} crc {mon_config_key=2684908918,monmap=1407976167,nvmeofgw=2319831493}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1091869665}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=34,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=55} crc {nvmeofgw=232830012,osd_metadata=2727074769,osd_pg_creating=2382909690,osd_snap=3842414688,osdmap=4174950277}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=58} crc {osdmap=998182440}) 2026-02-18T03:37:20.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3948878876' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:20.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1134783640' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {auth=47,config=2,health=13,kv=38} crc {auth=4253033114,config=1466402343,health=2716147082,kv=1199048720}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {kv=38,logm=62} crc {kv=3196826348,logm=2466945136}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3459656652}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3816521544}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3206255034}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208626193}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963378987}) 2026-02-18T03:37:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=586559314}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2079522818}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1881631836}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2872285101}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2556025366}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3156046030}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2574553391}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3628751713}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1228693389}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1656259098}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1050017186}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=701785473}) 2026-02-18T03:37:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1358146665}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=291097520}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=521403314}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734530399}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1178916480}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2667721244}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3635101155}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2585623107}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2494962704}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3495910434}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1889327265}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2254907229}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4102935371}) 2026-02-18T03:37:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=751274390}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2986584997}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405454811}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {logm=9,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=68} crc {logm=710779075,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=2787385243}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=35,mon_config_key=65} crc {mgrstat=877508999,mon_config_key=606033506}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=412218876}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=54,monmap=5,nvmeofgw=41} crc {mon_config_key=2684908918,monmap=1407976167,nvmeofgw=2319831493}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1091869665}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=34,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=55} crc {nvmeofgw=232830012,osd_metadata=2727074769,osd_pg_creating=2382909690,osd_snap=3842414688,osdmap=4174950277}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=58} crc {osdmap=998182440}) 2026-02-18T03:37:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:19 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3948878876' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:20 trial155 ceph-mon[87919]: pgmap v431: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.21k op/s 2026-02-18T03:37:21.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/240286507' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:20 trial034 ceph-mon[21825]: pgmap v431: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.21k op/s 2026-02-18T03:37:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/240286507' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:20 trial086 ceph-mon[73228]: pgmap v431: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.21k op/s 2026-02-18T03:37:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/240286507' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:21.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.7M 2.8M 0.0k 27.2M 28.1M 0.0k nvme12n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.90 2.6M 2.7M 0.0k 25.6M 27.3M 0.0k nvme16n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.8M 2.7M 0.0k 27.9M 27.5M 0.0k nvme20n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.8M 2.9M 0.0k 28.4M 28.7M 0.0k nvme24n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.7M 2.8M 0.0k 27.1M 27.9M 0.0k nvme28n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 2.7M 2.7M 0.0k 27.5M 26.9M 0.0k nvme32n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.6M 2.7M 0.0k 26.4M 27.0M 0.0k nvme36n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.50 2.7M 2.7M 0.0k 26.6M 27.1M 0.0k nvme40n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 2.7M 2.7M 0.0k 27.0M 26.8M 0.0k nvme44n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.7M 2.7M 0.0k 27.4M 27.0M 0.0k nvme48n3 2026-02-18T03:37:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 190.50 2.5M 2.7M 0.0k 25.4M 27.4M 0.0k nvme4n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.9M 2.7M 0.0k 29.0M 27.0M 0.0k nvme52n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 2.8M 2.6M 0.0k 28.3M 25.7M 0.0k nvme56n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.7M 2.8M 0.0k 26.7M 27.5M 0.0k nvme60n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 2.7M 2.9M 0.0k 26.5M 28.8M 0.0k nvme64n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.50 2.9M 2.8M 0.0k 29.0M 27.9M 0.0k nvme8n3 2026-02-18T03:37:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:21 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3131952349' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:22.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3131952349' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:21 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3131952349' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:22 trial155 ceph-mon[87919]: pgmap v432: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.31k op/s 2026-02-18T03:37:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:22 trial034 ceph-mon[21825]: pgmap v432: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.31k op/s 2026-02-18T03:37:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:22 trial086 ceph-mon[73228]: pgmap v432: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.31k op/s 2026-02-18T03:37:24.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:23 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1377651496' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1377651496' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:23 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1377651496' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:24 trial155 ceph-mon[87919]: pgmap v433: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.34k op/s 2026-02-18T03:37:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:24 trial034 ceph-mon[21825]: pgmap v433: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.34k op/s 2026-02-18T03:37:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:24 trial086 ceph-mon[73228]: pgmap v433: 33 pgs: 33 active+clean; 16 GiB data, 45 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 3.34k op/s 2026-02-18T03:37:27.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:26 trial155 ceph-mon[87919]: pgmap v434: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.14k op/s 2026-02-18T03:37:27.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:26 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1815634062' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:26 trial034 ceph-mon[21825]: pgmap v434: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.14k op/s 2026-02-18T03:37:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1815634062' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:26 trial086 ceph-mon[73228]: pgmap v434: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.14k op/s 2026-02-18T03:37:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:26 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1815634062' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:27 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3479826784' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3479826784' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:27 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3479826784' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:28 trial155 ceph-mon[87919]: pgmap v435: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.27k op/s 2026-02-18T03:37:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:28 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3321814052' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:28 trial034 ceph-mon[21825]: pgmap v435: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.27k op/s 2026-02-18T03:37:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3321814052' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:28 trial086 ceph-mon[73228]: pgmap v435: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.27k op/s 2026-02-18T03:37:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:28 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/3321814052' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:30 trial155 ceph-mon[87919]: pgmap v436: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.24k op/s 2026-02-18T03:37:31.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:30 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4266210075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:30 trial034 ceph-mon[21825]: pgmap v436: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.24k op/s 2026-02-18T03:37:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4266210075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:30 trial086 ceph-mon[73228]: pgmap v436: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.24k op/s 2026-02-18T03:37:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:30 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4266210075' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:31.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.7M 2.6M 0.0k 27.2M 26.4M 0.0k nvme12n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.7M 2.7M 0.0k 27.2M 26.6M 0.0k nvme16n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.6M 2.7M 0.0k 26.3M 26.9M 0.0k nvme20n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.5M 2.7M 0.0k 24.9M 26.6M 0.0k nvme24n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.7M 2.8M 0.0k 27.0M 27.9M 0.0k nvme28n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.6M 2.7M 0.0k 25.8M 26.5M 0.0k nvme32n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.50 2.7M 2.7M 0.0k 26.5M 27.4M 0.0k nvme36n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.6M 2.7M 0.0k 26.2M 26.6M 0.0k nvme40n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.7M 2.7M 0.0k 26.6M 27.1M 0.0k nvme44n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 2.6M 2.7M 0.0k 26.0M 26.8M 0.0k nvme48n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.7M 2.7M 0.0k 27.1M 27.4M 0.0k nvme4n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.6M 2.8M 0.0k 26.3M 27.8M 0.0k nvme52n3 2026-02-18T03:37:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.7M 2.7M 0.0k 26.6M 26.7M 0.0k nvme56n3 2026-02-18T03:37:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.40 2.7M 2.6M 0.0k 27.1M 25.9M 0.0k nvme60n3 2026-02-18T03:37:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.6M 2.6M 0.0k 26.0M 26.0M 0.0k nvme64n3 2026-02-18T03:37:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.90 2.7M 2.7M 0.0k 27.0M 27.3M 0.0k nvme8n3 2026-02-18T03:37:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:32 trial155 ceph-mon[87919]: pgmap v437: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:37:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:32 trial034 ceph-mon[21825]: pgmap v437: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:37:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:32 trial086 ceph-mon[73228]: pgmap v437: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:37:34.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:33 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1468992291' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:34.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1468992291' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:33 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1468992291' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:34 trial155 ceph-mon[87919]: pgmap v438: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.36k op/s 2026-02-18T03:37:35.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3616337619' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:34 trial034 ceph-mon[21825]: pgmap v438: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.36k op/s 2026-02-18T03:37:35.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3616337619' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:34 trial086 ceph-mon[73228]: pgmap v438: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.36k op/s 2026-02-18T03:37:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:34 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/3616337619' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:36.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:35 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/850569507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/850569507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:35 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/850569507' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:36 trial155 ceph-mon[87919]: pgmap v439: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.17k op/s 2026-02-18T03:37:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:36 trial034 ceph-mon[21825]: pgmap v439: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.17k op/s 2026-02-18T03:37:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:36 trial086 ceph-mon[73228]: pgmap v439: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.17k op/s 2026-02-18T03:37:38.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:37 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3593367153' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:38.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:37 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3593367153' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:37 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3593367153' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:38 trial155 ceph-mon[87919]: pgmap v440: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.29k op/s 2026-02-18T03:37:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:38 trial034 ceph-mon[21825]: pgmap v440: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.29k op/s 2026-02-18T03:37:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:38 trial086 ceph-mon[73228]: pgmap v440: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.29k op/s 2026-02-18T03:37:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:40 trial155 ceph-mon[87919]: pgmap v441: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 42 MiB/s wr, 3.24k op/s 2026-02-18T03:37:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:40 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2634711220' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:40 trial034 ceph-mon[21825]: pgmap v441: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 42 MiB/s wr, 3.24k op/s 2026-02-18T03:37:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:40 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2634711220' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:40 trial086 ceph-mon[73228]: pgmap v441: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 42 MiB/s wr, 3.24k op/s 2026-02-18T03:37:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:40 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2634711220' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:41.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 211.20 2.9M 2.6M 0.0k 28.7M 26.0M 0.0k nvme12n3 2026-02-18T03:37:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.10 2.4M 2.6M 0.0k 24.0M 26.4M 0.0k nvme16n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.70 2.7M 2.5M 0.0k 26.6M 25.1M 0.0k nvme20n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.6M 2.6M 0.0k 25.5M 26.2M 0.0k nvme24n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.5M 2.5M 0.0k 24.9M 25.3M 0.0k nvme28n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 211.00 2.7M 2.6M 0.0k 27.1M 26.0M 0.0k nvme32n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 2.5M 2.5M 0.0k 24.9M 24.6M 0.0k nvme36n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 2.6M 2.7M 0.0k 25.6M 27.2M 0.0k nvme40n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.5M 2.6M 0.0k 25.0M 26.5M 0.0k nvme44n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 2.6M 2.4M 0.0k 25.5M 23.8M 0.0k nvme48n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.5M 2.6M 0.0k 25.3M 25.8M 0.0k nvme4n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.5M 2.6M 0.0k 25.3M 26.0M 0.0k nvme52n3 2026-02-18T03:37:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.6M 2.6M 0.0k 25.8M 26.1M 0.0k nvme56n3 2026-02-18T03:37:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.00 2.7M 2.6M 0.0k 27.3M 26.0M 0.0k nvme60n3 2026-02-18T03:37:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.6M 2.7M 0.0k 25.6M 26.6M 0.0k nvme64n3 2026-02-18T03:37:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 2.6M 2.5M 0.0k 25.7M 24.6M 0.0k nvme8n3 2026-02-18T03:37:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:42.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/557305956' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:42.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/557305956' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:41 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/557305956' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:42 trial034 ceph-mon[21825]: pgmap v442: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:37:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:42 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/157644665' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:42 trial086 ceph-mon[73228]: pgmap v442: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:37:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:42 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/157644665' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:42 trial155 ceph-mon[87919]: pgmap v442: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:37:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:42 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/157644665' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:44 trial034 ceph-mon[21825]: pgmap v443: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.38k op/s 2026-02-18T03:37:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:44 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1267907623' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:44 trial086 ceph-mon[73228]: pgmap v443: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.38k op/s 2026-02-18T03:37:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:44 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1267907623' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:44 trial155 ceph-mon[87919]: pgmap v443: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.38k op/s 2026-02-18T03:37:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:44 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1267907623' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:46 trial034 ceph-mon[21825]: pgmap v444: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.15k op/s 2026-02-18T03:37:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:46 trial086 ceph-mon[73228]: pgmap v444: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.15k op/s 2026-02-18T03:37:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:46 trial155 ceph-mon[87919]: pgmap v444: 33 pgs: 33 active+clean; 16 GiB data, 46 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.15k op/s 2026-02-18T03:37:48.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:47 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1302311473' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:47 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/1302311473' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:47 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1302311473' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:48 trial034 ceph-mon[21825]: pgmap v445: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:37:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2899324348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:48 trial086 ceph-mon[73228]: pgmap v445: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:37:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:48 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2899324348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:48 trial155 ceph-mon[87919]: pgmap v445: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:37:49.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2899324348' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:50.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:49 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1791928745' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:49 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1791928745' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:49 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1791928745' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:50 trial034 ceph-mon[21825]: pgmap v446: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.23k op/s 2026-02-18T03:37:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:50 trial086 ceph-mon[73228]: pgmap v446: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.23k op/s 2026-02-18T03:37:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:50 trial155 ceph-mon[87919]: pgmap v446: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.23k op/s 2026-02-18T03:37:51.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:51.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:37:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.30 2.7M 2.5M 0.0k 26.9M 25.2M 0.0k nvme12n3 2026-02-18T03:37:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.5M 2.5M 0.0k 24.7M 25.4M 0.0k nvme16n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.4M 2.4M 0.0k 23.7M 23.8M 0.0k nvme20n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 2.3M 2.5M 0.0k 23.5M 24.9M 0.0k nvme24n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.3M 2.5M 0.0k 23.1M 24.8M 0.0k nvme28n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.3M 2.4M 0.0k 23.2M 24.4M 0.0k nvme32n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.5M 2.4M 0.0k 24.6M 24.4M 0.0k nvme36n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.80 2.6M 2.5M 0.0k 26.1M 25.3M 0.0k nvme40n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.3M 2.5M 0.0k 22.9M 25.1M 0.0k nvme44n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.3M 2.4M 0.0k 23.5M 23.6M 0.0k nvme48n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.5M 2.5M 0.0k 25.4M 25.0M 0.0k nvme4n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.90 2.4M 2.6M 0.0k 24.4M 25.9M 0.0k nvme52n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.50 2.5M 2.5M 0.0k 25.4M 24.9M 0.0k nvme56n3 2026-02-18T03:37:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 2.5M 2.4M 0.0k 25.2M 24.4M 0.0k nvme60n3 2026-02-18T03:37:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 213.90 2.8M 2.5M 0.0k 28.5M 25.1M 0.0k nvme64n3 2026-02-18T03:37:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.00 2.5M 2.4M 0.0k 24.9M 24.1M 0.0k nvme8n3 2026-02-18T03:37:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:37:52.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:51 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3019006651' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:51 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3019006651' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:51 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3019006651' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:52 trial034 ceph-mon[21825]: pgmap v447: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.34k op/s 2026-02-18T03:37:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:52 trial086 ceph-mon[73228]: pgmap v447: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.34k op/s 2026-02-18T03:37:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:52 trial155 ceph-mon[87919]: pgmap v447: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.34k op/s 2026-02-18T03:37:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:54 trial034 ceph-mon[21825]: pgmap v448: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.37k op/s 2026-02-18T03:37:55.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:54 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2491213513' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:54 trial086 ceph-mon[73228]: pgmap v448: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.37k op/s 2026-02-18T03:37:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:54 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2491213513' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:54 trial155 ceph-mon[87919]: pgmap v448: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.37k op/s 2026-02-18T03:37:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:54 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2491213513' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/236947783' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:56 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/236947783' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/236947783' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:57 trial034 ceph-mon[21825]: pgmap v449: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.16k op/s 2026-02-18T03:37:57.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4216088941' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:57 trial086 ceph-mon[73228]: pgmap v449: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.16k op/s 2026-02-18T03:37:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:57 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/4216088941' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:57 trial155 ceph-mon[87919]: pgmap v449: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.16k op/s 2026-02-18T03:37:57.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:57 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4216088941' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:59 trial034 ceph-mon[21825]: pgmap v450: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.30k op/s 2026-02-18T03:37:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:37:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4288433301' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:59 trial086 ceph-mon[73228]: pgmap v450: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.30k op/s 2026-02-18T03:37:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:37:59 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/4288433301' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:37:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:59 trial155 ceph-mon[87919]: pgmap v450: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.30k op/s 2026-02-18T03:37:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:37:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4288433301' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:01 trial034 ceph-mon[21825]: pgmap v451: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.25k op/s 2026-02-18T03:38:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:01 trial086 ceph-mon[73228]: pgmap v451: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.25k op/s 2026-02-18T03:38:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:01 trial155 ceph-mon[87919]: pgmap v451: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.25k op/s 2026-02-18T03:38:01.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.20 2.5M 2.5M 0.0k 24.8M 25.0M 0.0k nvme12n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.3M 2.5M 0.0k 23.4M 24.5M 0.0k nvme16n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.4M 2.3M 0.0k 24.0M 23.4M 0.0k nvme20n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.6M 2.4M 0.0k 25.6M 24.2M 0.0k nvme24n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.10 2.4M 2.3M 0.0k 23.5M 22.9M 0.0k nvme28n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.50 2.5M 2.3M 0.0k 24.7M 22.9M 0.0k nvme32n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.4M 2.4M 0.0k 24.3M 24.4M 0.0k nvme36n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.4M 2.3M 0.0k 23.9M 23.3M 0.0k nvme40n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.70 2.5M 2.4M 0.0k 24.7M 24.0M 0.0k nvme44n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 2.5M 2.4M 0.0k 24.9M 24.3M 0.0k nvme48n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.4M 2.5M 0.0k 23.6M 24.7M 0.0k nvme4n3 2026-02-18T03:38:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.6M 2.4M 0.0k 26.1M 23.9M 0.0k nvme52n3 2026-02-18T03:38:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.3M 2.4M 0.0k 23.0M 24.1M 0.0k nvme56n3 2026-02-18T03:38:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.3M 2.4M 0.0k 23.1M 23.6M 0.0k nvme60n3 2026-02-18T03:38:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 2.5M 2.5M 0.0k 24.9M 24.8M 0.0k nvme64n3 2026-02-18T03:38:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.20 2.4M 2.4M 0.0k 24.4M 24.4M 0.0k nvme8n3 2026-02-18T03:38:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:02.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3203263353' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:02 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3203263353' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3203263353' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:03 trial034 ceph-mon[21825]: pgmap v452: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.34k op/s 2026-02-18T03:38:03.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:03 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2708280632' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:03.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:03 trial086 ceph-mon[73228]: pgmap v452: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.34k op/s 2026-02-18T03:38:03.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:03 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/2708280632' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:03 trial155 ceph-mon[87919]: pgmap v452: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.34k op/s 2026-02-18T03:38:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:03 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2708280632' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:04.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/87284337' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:04 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/87284337' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:04 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/87284337' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:05 trial034 ceph-mon[21825]: pgmap v453: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.19k op/s 2026-02-18T03:38:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:05 trial086 ceph-mon[73228]: pgmap v453: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.19k op/s 2026-02-18T03:38:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:05 trial155 ceph-mon[87919]: pgmap v453: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.19k op/s 2026-02-18T03:38:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:06 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/3333687051' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3333687051' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3333687051' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:07 trial086 ceph-mon[73228]: pgmap v454: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.17k op/s 2026-02-18T03:38:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:07 trial155 ceph-mon[87919]: pgmap v454: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.17k op/s 2026-02-18T03:38:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:07 trial034 ceph-mon[21825]: pgmap v454: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.17k op/s 2026-02-18T03:38:09.280 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:09 trial155 ceph-mon[87919]: pgmap v455: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.31k op/s 2026-02-18T03:38:09.280 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3007249901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:09 trial086 ceph-mon[73228]: pgmap v455: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.31k op/s 2026-02-18T03:38:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:09 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/3007249901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:09 trial034 ceph-mon[21825]: pgmap v455: 33 pgs: 33 active+clean; 16 GiB data, 47 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.31k op/s 2026-02-18T03:38:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3007249901' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:10 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/4024317208' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:10 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/4024317208' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:10.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:10 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4024317208' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:11 trial086 ceph-mon[73228]: pgmap v456: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 3.27k op/s 2026-02-18T03:38:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:11 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/2884668031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:11.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:11 trial034 ceph-mon[21825]: pgmap v456: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 3.27k op/s 2026-02-18T03:38:11.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2884668031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:11 trial155 ceph-mon[87919]: pgmap v456: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 37 MiB/s wr, 3.27k op/s 2026-02-18T03:38:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:11 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/2884668031' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:11.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:11.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 209.60 2.4M 2.4M 0.0k 24.5M 24.0M 0.0k nvme12n3 2026-02-18T03:38:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 205.20 2.4M 2.4M 0.0k 23.7M 23.6M 0.0k nvme16n3 2026-02-18T03:38:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.4M 2.3M 0.0k 23.8M 22.9M 0.0k nvme20n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.80 2.4M 2.4M 0.0k 23.7M 23.7M 0.0k nvme24n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.4M 2.3M 0.0k 23.8M 23.2M 0.0k nvme28n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.3M 2.3M 0.0k 22.6M 22.5M 0.0k nvme32n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 2.3M 2.3M 0.0k 23.1M 22.9M 0.0k nvme36n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.3M 2.3M 0.0k 22.9M 23.3M 0.0k nvme40n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.60 2.4M 2.3M 0.0k 24.3M 23.3M 0.0k nvme44n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.30 2.2M 2.4M 0.0k 21.8M 24.2M 0.0k nvme48n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.4M 2.4M 0.0k 24.3M 24.0M 0.0k nvme4n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.3M 2.3M 0.0k 23.3M 23.0M 0.0k nvme52n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 2.4M 2.3M 0.0k 24.2M 23.0M 0.0k nvme56n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 2.4M 2.4M 0.0k 24.2M 23.6M 0.0k nvme60n3 2026-02-18T03:38:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.5M 2.3M 0.0k 25.0M 23.0M 0.0k nvme64n3 2026-02-18T03:38:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.3M 2.3M 0.0k 22.9M 23.2M 0.0k nvme8n3 2026-02-18T03:38:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:13 trial086 ceph-mon[73228]: pgmap v457: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.36k op/s 2026-02-18T03:38:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:13 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/1079268326' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:13 trial155 ceph-mon[87919]: pgmap v457: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.36k op/s 2026-02-18T03:38:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1079268326' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:13 trial034 ceph-mon[21825]: pgmap v457: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.36k op/s 2026-02-18T03:38:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1079268326' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:14.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:38:14.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:38:14.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:38:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:15 trial086 ceph-mon[73228]: pgmap v458: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.22k op/s 2026-02-18T03:38:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:15 trial155 ceph-mon[87919]: pgmap v458: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.22k op/s 2026-02-18T03:38:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:15 trial034 ceph-mon[21825]: pgmap v458: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.22k op/s 2026-02-18T03:38:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/736075033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:16 trial086 ceph-mon[73228]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/736075033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:16.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:16.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:16.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:16.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:16 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/736075033' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:16 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:17 trial086 ceph-mon[73228]: pgmap v459: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.35k op/s 2026-02-18T03:38:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:17 trial086 ceph-mon[73228]: from='client.? 10.20.193.34:0/1840603985' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:17 trial155 ceph-mon[87919]: pgmap v459: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.35k op/s 2026-02-18T03:38:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:17 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1840603985' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:17 trial034 ceph-mon[21825]: pgmap v459: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.35k op/s 2026-02-18T03:38:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:17 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1840603985' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:18.046 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:38:18.046 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:38:18.047 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:38:18.075 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 2min 25s ago 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 330.3M (peak: 332.2M) 2026-02-18T03:38:18.076 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 9min 33.977s 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:38:18.077 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:18.078 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:36:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:39618 2026-02-18T03:38:18.080 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:38:18.111 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:35:56 UTC; 2min 21s ago 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86275 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86276 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 86357 (conmon) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 327.7M (peak: 330.0M) 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 9min 14.500s 2026-02-18T03:38:18.112 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86359 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86361 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86453 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─86833 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: │ └─86861 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: └─86357 /usr/bin/conmon --api-version 1 -c c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 -u c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata -p /run/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:38:18.113 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.726883] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000143 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.742884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000152 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.758865] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000137 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.782866] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000131 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.798884] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000155 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.814876] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000146 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.830904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000167 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.862871] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000135 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.878867] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000134 seconds 2026-02-18T03:38:18.114 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:36:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [2026-02-18 03:36:14.894857] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000119 seconds 2026-02-18T03:38:18.115 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 4min 7s ago 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 360.3M (peak: 362.0M) 2026-02-18T03:38:18.148 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 16min 18.815s 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:38:18.149 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:36:11 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:50304 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:38:18.150 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:13 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:13] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:38:18.152 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:35:58 UTC; 2min 19s ago 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51439 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51440 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:38:18.190 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 51517 (conmon) 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 355.4M (peak: 356.6M) 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 9min 30.215s 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51519 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51521 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51613 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─51819 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: │ └─51824 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:38:18.191 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout: └─51517 /usr/bin/conmon --api-version 1 -c aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f -u aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata -p /run/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.751377] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000181 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.767369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000175 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.783355] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000161 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.799372] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000178 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.815369] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000178 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.831475] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000279 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.847451] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000251 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.871452] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000251 seconds 2026-02-18T03:38:18.192 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.911477] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000261 seconds 2026-02-18T03:38:18.193 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:36:15 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [2026-02-18 03:36:15.927609] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000390 seconds 2026-02-18T03:38:18.194 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:38:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:18 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/1649758748' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:18.415 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:38:18.415 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 63s ago 13m trial034=x;count:1 2026-02-18T03:38:18.415 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 4m ago 13m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:38:18.416 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 4m ago 11m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:38:18.416 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 4m ago 12m trial155 2026-02-18T03:38:18.424 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:38:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:18 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1649758748' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:18.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1649758748' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:18.607 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:38:18.607 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (2m) 63s ago 2m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:38:18.607 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (2m) 63s ago 2m 335M - 1.6.5 99a57256b38c c572dc4418fe 2026-02-18T03:38:18.607 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (4m) 4m ago 8m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:38:18.607 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (2m) 63s ago 2m 350M - 1.6.5 99a57256b38c aafd1145cff6 2026-02-18T03:38:18.616 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:38:18.842 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:38:18.851 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:38:19.073 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:38:19.073 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 65s) [leader: a] 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 13m) 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 12m), 8 in (since 12m) 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:38:19.074 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: usage: 48 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: client: 37 MiB/s rd, 37 MiB/s wr, 1.64k op/s rd, 1.65k op/s wr 2026-02-18T03:38:19.075 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:38:19.082 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:38:19.139 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:38:19.321 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 173, 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 3, 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 88, 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:38:19.322 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:38:19.323 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:38:19.324 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:38:19.325 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:38:19.326 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:38:19.326 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:38:19.331 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:38:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:19 trial086 ceph-mon[73228]: pgmap v460: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.29k op/s 2026-02-18T03:38:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:19 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/702562095' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:38:19.388 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.389 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.390 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.391 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.392 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.393 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.394 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:38:19.395 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:38:19.441 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.443 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:38:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:19 trial155 ceph-mon[87919]: pgmap v460: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.29k op/s 2026-02-18T03:38:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:19 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/702562095' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:38:19.487 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.488 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:38:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:19 trial034 ceph-mon[21825]: pgmap v460: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.29k op/s 2026-02-18T03:38:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/702562095' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:38:19.572 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.573 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:38:19.618 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.619 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:38:19.663 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.664 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:38:19.709 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.710 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:38:19.753 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.754 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:38:19.838 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.839 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:38:19.883 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.885 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:38:19.929 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.930 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:38:19.975 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:19.976 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:38:20.020 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.021 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:38:20.106 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.107 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:38:20.151 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.152 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:38:20.236 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.236 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:38:20.282 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.283 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:38:20.328 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.329 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:38:20.373 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.374 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:38:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:20 trial086 ceph-mon[73228]: from='client.76010 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:20 trial086 ceph-mon[73228]: from='client.61362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/986626616' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:38:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.177:0/45765533' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:38:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:20 trial086 ceph-mon[73228]: from='client.? 10.20.193.155:0/2335222407' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:20.458 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.459 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:38:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:20 trial155 ceph-mon[87919]: from='client.76010 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:20 trial155 ceph-mon[87919]: from='client.61362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/986626616' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:38:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/45765533' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:38:20.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2335222407' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:20.503 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.504 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:38:20.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:20 trial034 ceph-mon[21825]: from='client.76010 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:20 trial034 ceph-mon[21825]: from='client.61362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/986626616' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:38:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/45765533' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:38:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2335222407' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:20.589 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.589 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:38:20.632 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.634 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:38:20.677 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.679 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:38:20.763 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.764 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:38:20.809 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.810 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:38:20.855 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.855 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:38:20.901 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.902 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:38:20.946 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:20.947 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:38:21.031 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.032 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:38:21.117 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.117 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:38:21.162 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.162 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:38:21.247 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.248 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:38:21.331 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.332 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:38:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:21 trial086 ceph-mon[73228]: pgmap v461: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.23k op/s 2026-02-18T03:38:21.378 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.379 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:38:21.425 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.426 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:38:21.471 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.472 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:38:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:21 trial155 ceph-mon[87919]: pgmap v461: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.23k op/s 2026-02-18T03:38:21.516 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.518 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:38:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:21 trial034 ceph-mon[21825]: pgmap v461: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.23k op/s 2026-02-18T03:38:21.562 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.563 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:38:21.609 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.610 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:38:21.656 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.657 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:38:21.701 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.702 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:38:21.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 209.00 2.4M 2.3M 0.0k 23.6M 22.8M 0.0k nvme12n3 2026-02-18T03:38:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.3M 2.2M 0.0k 22.5M 22.3M 0.0k nvme16n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.2M 2.3M 0.0k 21.8M 22.6M 0.0k nvme20n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.40 2.2M 2.3M 0.0k 21.8M 23.0M 0.0k nvme24n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.70 2.2M 2.3M 0.0k 21.6M 23.1M 0.0k nvme28n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.0M 2.2M 0.0k 20.4M 21.9M 0.0k nvme32n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.00 2.3M 2.3M 0.0k 22.9M 23.2M 0.0k nvme36n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 2.3M 2.3M 0.0k 22.7M 22.9M 0.0k nvme40n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.1M 2.3M 0.0k 21.1M 23.1M 0.0k nvme44n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.3M 2.2M 0.0k 22.5M 22.0M 0.0k nvme48n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.3M 2.3M 0.0k 22.7M 23.4M 0.0k nvme4n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.2M 2.2M 0.0k 21.7M 22.2M 0.0k nvme52n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.60 2.1M 2.3M 0.0k 20.6M 23.4M 0.0k nvme56n3 2026-02-18T03:38:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.1M 2.3M 0.0k 21.2M 23.4M 0.0k nvme60n3 2026-02-18T03:38:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.00 2.4M 2.2M 0.0k 23.7M 21.9M 0.0k nvme64n3 2026-02-18T03:38:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.2M 2.2M 0.0k 22.0M 22.2M 0.0k nvme8n3 2026-02-18T03:38:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:21.747 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.748 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:38:21.833 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.834 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:38:21.879 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.880 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:38:21.924 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.925 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:38:21.971 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:21.972 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:38:22.017 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.019 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:38:22.062 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.063 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:38:22.108 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.110 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:38:22.154 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.156 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:38:22.199 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.200 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:38:22.245 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.247 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:38:22.292 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.293 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:38:22.338 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.339 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:38:22.383 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.385 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:38:22.428 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.429 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:38:22.514 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.515 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:38:22.561 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.562 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:38:22.606 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.608 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:38:22.652 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.653 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:38:22.698 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.699 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:38:22.743 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.744 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:38:22.788 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.789 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:38:22.834 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:38:22.836 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:38:22.836 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:38:22.836 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:38:22.836 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.b 2026-02-18T03:38:22.836 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon stop nvmeof.nvmeof.b 2026-02-18T03:38:22.836 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:38:22.836 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:38:22.836 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:38:23.057 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to stop nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:38:23.067 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:38:23.067 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.d 2026-02-18T03:38:23.067 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon stop nvmeof.nvmeof.d 2026-02-18T03:38:23.080 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":69,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:38:23.091 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:38:23.091 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:38:23.091 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:38:23.091 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:38:23.111 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:23 trial034 ceph-mon[21825]: pgmap v462: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.31k op/s 2026-02-18T03:38:23.111 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/2592670590' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 852598, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 69, 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:38:23.174 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:23.175 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.176 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.177 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:38:23.178 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "num": 85 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:38:23.179 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:38:23.181 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:38:23.181 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:38:23.181 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:38:23.259 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to stop nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:38:23.269 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 84 secs before reviving 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 417601, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 69, 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.300 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.301 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.302 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "num": 4 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.303 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: "num": 63 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:38:23.304 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:38:23.307 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:38:23.307 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:38:23.307 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:38:23.308 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-mon[73228]: pgmap v462: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.31k op/s 2026-02-18T03:38:23.308 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-mon[73228]: from='client.? 10.20.193.86:0/2592670590' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:23.384 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:38:23.384 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:23.384 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:23.384 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 32, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 69726, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 69, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:38:23.385 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.386 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:23.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:38:23.388 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:38:23.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:38:23.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['b'] 2026-02-18T03:38:23.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:38:23.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.b 2026-02-18T03:38:23.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.b 2026-02-18T03:38:23.391 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-18T03:38:23.392 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b 2026-02-18T03:38:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:23 trial155 ceph-mon[87919]: pgmap v462: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.31k op/s 2026-02-18T03:38:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:23 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2592670590' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:23.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:38:23.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:23] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:38:23.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:23] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:38:23.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:23] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.86:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.86:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:38:23.575 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:23] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 systemd[1]: Stopping Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[73203]: 2026-02-18T03:38:23.499+0000 7fe60a8db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[73203]: 2026-02-18T03:38:23.499+0000 7fe60a8db640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 podman[97735]: 2026-02-18 03:38:23.541610313 +0000 UTC m=+0.056754472 container died 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 podman[97735]: 2026-02-18 03:38:23.552735856 +0000 UTC m=+0.067880005 container remove 3f7973a8650ef4e76147ec817cb25acb96c54aea2b5be2d6964738ff4eef7b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, ceph=True, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:38:23.575 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:38:23 trial086 bash[97735]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b 2026-02-18T03:38:23.636 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service' 2026-02-18T03:38:23.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:38:23.672 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-18T03:38:23.673 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:38:23.673 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:38:23.924 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":70,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:38:24.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:23 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:23] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:38:26.936 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:38:27.189 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":73,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:38:27.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial086) 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 podman[97669]: 2026-02-18 03:38:27.189892395 +0000 UTC m=+3.823392160 container died c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, release=, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, version=1.6.5, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.nvmeof=, org.centos.version=9.0-30.el9, io.ceph.component=ceph-nvmeof, io.spdk.version=25.09, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.openshift.wants=ceph,rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, architecture=x86_64) 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 podman[97669]: 2026-02-18 03:38:27.202904457 +0000 UTC m=+3.836404232 container remove c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.build.makeflags=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.ceph.version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, build-date=2026-02-11 09:53:49 UTC, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, name=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, release=, url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, io.ceph.nvmeof=, io.spdk.git.branch=undefined, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.6.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:38:27.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 bash[97669]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:38:27.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:38:27.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:38:27.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 9min 46.775s CPU time, 330.0M memory peak. 2026-02-18T03:38:30.201 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:38:30.449 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":76,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:38:31.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.2M 2.2M 0.0k 21.9M 22.4M 0.0k nvme12n3 2026-02-18T03:38:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.0M 2.2M 0.0k 20.4M 22.2M 0.0k nvme16n3 2026-02-18T03:38:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.90 2.3M 2.2M 0.0k 23.1M 21.7M 0.0k nvme20n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.3M 2.1M 0.0k 23.2M 20.8M 0.0k nvme24n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.2M 2.1M 0.0k 22.3M 21.5M 0.0k nvme28n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 2.2M 2.1M 0.0k 21.6M 21.0M 0.0k nvme32n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.0M 2.2M 0.0k 20.1M 21.9M 0.0k nvme36n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.2M 2.3M 0.0k 22.1M 22.8M 0.0k nvme40n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 2.4M 2.2M 0.0k 23.6M 22.3M 0.0k nvme44n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.1M 2.1M 0.0k 20.9M 20.8M 0.0k nvme48n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 189.10 1.9M 2.1M 0.0k 19.4M 20.9M 0.0k nvme4n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.3M 2.2M 0.0k 23.1M 22.4M 0.0k nvme52n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.00 2.0M 2.1M 0.0k 20.4M 21.4M 0.0k nvme56n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 2.1M 2.2M 0.0k 20.9M 22.0M 0.0k nvme60n3 2026-02-18T03:38:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 2.2M 2.2M 0.0k 21.5M 22.4M 0.0k nvme64n3 2026-02-18T03:38:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.1M 2.2M 0.0k 20.5M 21.7M 0.0k nvme8n3 2026-02-18T03:38:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:33.462 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: purged_snaps scrub ok 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='client.76052 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: Schedule stop daemon nvmeof.nvmeof.b 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/397657163' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1275788899' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:38.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/42625081' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:38.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:38 trial177 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:38:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:38] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:38:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:38] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:38:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.177:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.177:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:38:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:38:38.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: purged_snaps scrub ok 2026-02-18T03:38:38.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: purged_snaps scrub ok 2026-02-18T03:38:38.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: purged_snaps scrub ok 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: purged_snaps scrub ok 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='client.76052 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: Schedule stop daemon nvmeof.nvmeof.b 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/397657163' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:38.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1275788899' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:38.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/42625081' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.61410 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: Schedule stop daemon nvmeof.nvmeof.d 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v463: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 3.17k op/s 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/543870920' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v464: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.32k op/s 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/249140613' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3600618139' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v465: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.30k op/s 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v466: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.26k op/s 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2819259390' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/399478421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v467: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.36k op/s 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: mon.c calling monitor election 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v468: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.23k op/s 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v469: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.36k op/s 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: pgmap v470: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.30k op/s 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:38:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 14m) 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:38:39.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:39.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:39 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:39.630 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.61410 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.d", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: Schedule stop daemon nvmeof.nvmeof.d 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v463: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 36 MiB/s wr, 3.17k op/s 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/543870920' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v464: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.32k op/s 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/249140613' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3600618139' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v465: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.30k op/s 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v466: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.26k op/s 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2819259390' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:39.631 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/399478421' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v467: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.36k op/s 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: mon.c calling monitor election 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: mon.a calling monitor election 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v468: 33 pgs: 33 active+clean; 16 GiB data, 48 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.23k op/s 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v469: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.36k op/s 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: pgmap v470: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.30k op/s 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: monmap epoch 3 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:38:39.632 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: min_mon_release 20 (tentacle) 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: election_strategy: 1 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: fsmap 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: osdmap e55: 8 total, 8 up, 8 in 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: mgrmap e15: x(active, since 14m) 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:39.633 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:39 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:39.707 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":36,"quorum":[0,1],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:38:39.719 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:38:39.719 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:38:39.720 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 36, 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 869219, 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:38:39.796 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: 1 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.797 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:38:39.798 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.799 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.800 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:39.801 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:38:39.802 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:39.803 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.804 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.805 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.806 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.807 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.808 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.809 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.810 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.811 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "num": 7 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "num": 77 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:38:39.812 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:38:39.813 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:38:39.815 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:38:39.815 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon c 2026-02-18T03:38:39.815 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 36, 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 86233, 2026-02-18T03:38:39.892 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: 1 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.893 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:38:39.894 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.895 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:38:39.896 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:38:39.897 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.898 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.899 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.900 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:38:39.901 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:38:39.902 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.903 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.904 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:39.905 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:38:39.906 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:38:39.908 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:38:39.908 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial177) 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:38:40.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 podman[63008]: 2026-02-18 03:38:39.887917656 +0000 UTC m=+1.410171234 container died aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.nvmeof=, build-date=2026-02-11 09:53:49 UTC, vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, release=, name=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.ceph.version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, summary=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public) 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 podman[63008]: 2026-02-18 03:38:39.902114431 +0000 UTC m=+1.424368009 container remove aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-type=git, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, io.spdk.build.target-arch=x86-64-v2, name=ceph-nvmeof, io.spdk.version=25.09, io.spdk.build.makeflags=, architecture=x86_64, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, io.ceph.nvmeof=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.openshift.wants=ceph,rbd, version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc.) 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 bash[63008]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:38:40.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 10min 58.319s CPU time, 356.6M memory peak. 2026-02-18T03:38:40.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/76362755' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: pgmap v471: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 35 MiB/s wr, 3.22k op/s 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/76362755' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: pgmap v471: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 35 MiB/s wr, 3.22k op/s 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:38:40.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:40.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 138.10 1.5M 1.5M 0.0k 14.5M 15.2M 0.0k nvme12n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 136.70 1.4M 1.5M 0.0k 14.3M 15.0M 0.0k nvme16n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 141.20 1.4M 1.5M 0.0k 14.2M 15.1M 0.0k nvme20n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 136.20 1.5M 1.4M 0.0k 15.1M 14.3M 0.0k nvme24n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 134.30 1.5M 1.5M 0.0k 14.9M 15.1M 0.0k nvme28n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 139.10 1.4M 1.4M 0.0k 14.4M 14.5M 0.0k nvme32n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 136.60 1.5M 1.4M 0.0k 15.0M 14.4M 0.0k nvme36n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 139.60 1.5M 1.6M 0.0k 15.0M 15.6M 0.0k nvme40n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 139.60 1.4M 1.5M 0.0k 14.1M 15.1M 0.0k nvme44n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 140.10 1.4M 1.5M 0.0k 14.2M 14.5M 0.0k nvme48n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 138.50 1.4M 1.5M 0.0k 14.4M 15.2M 0.0k nvme4n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 134.10 1.4M 1.5M 0.0k 14.3M 14.8M 0.0k nvme52n3 2026-02-18T03:38:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 138.00 1.5M 1.6M 0.0k 14.9M 15.7M 0.0k nvme56n3 2026-02-18T03:38:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 133.90 1.3M 1.4M 0.0k 13.3M 14.4M 0.0k nvme60n3 2026-02-18T03:38:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 135.90 1.4M 1.6M 0.0k 14.0M 16.0M 0.0k nvme64n3 2026-02-18T03:38:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 135.10 1.3M 1.5M 0.0k 13.2M 14.8M 0.0k nvme8n3 2026-02-18T03:38:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:41.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:41.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:41.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:41 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:41.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:38:41.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:38:41.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:38:41.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:41 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:38:42.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:42 trial034 ceph-mon[21825]: pgmap v472: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.89k op/s 2026-02-18T03:38:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:42 trial155 ceph-mon[87919]: pgmap v472: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.89k op/s 2026-02-18T03:38:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:44 trial155 ceph-mon[87919]: pgmap v473: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 26 MiB/s wr, 2.45k op/s 2026-02-18T03:38:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:44 trial034 ceph-mon[21825]: pgmap v473: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 26 MiB/s wr, 2.45k op/s 2026-02-18T03:38:45.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/123034120' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/367908837' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-mon[87919]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:38:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-mon[87919]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:38:45] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:38:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:48450 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.664592] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000207 seconds 2026-02-18T03:38:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.680517] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000168 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.696555] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000197 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.712545] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000195 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.728593] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000194 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.752610] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000215 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.768618] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000212 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.784592] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000181 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.800663] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000264 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.816631] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000219 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.844705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000257 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.860644] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000215 seconds 2026-02-18T03:38:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.872638] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000212 seconds 2026-02-18T03:38:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/123034120' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/367908837' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-mon[21825]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:38:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-mon[21825]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:38:45] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:38:46.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:38:46.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:34638 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.665925] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000152 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.681885] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000147 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.697834] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000111 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.713863] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000135 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.729867] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000140 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.745897] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000167 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.769891] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000154 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.785910] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000165 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.801929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000192 seconds 2026-02-18T03:38:46.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.817955] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000208 seconds 2026-02-18T03:38:46.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.833958] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000208 seconds 2026-02-18T03:38:46.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.849947] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000180 seconds 2026-02-18T03:38:46.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.865973] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000216 seconds 2026-02-18T03:38:46.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.881935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000173 seconds 2026-02-18T03:38:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:46 trial155 ceph-mon[87919]: pgmap v475: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 17 MiB/s wr, 1.68k op/s 2026-02-18T03:38:47.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:46 trial034 ceph-mon[21825]: pgmap v475: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 17 MiB/s wr, 1.68k op/s 2026-02-18T03:38:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:48 trial155 ceph-mon[87919]: pgmap v476: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 1.21k op/s 2026-02-18T03:38:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:48 trial034 ceph-mon[21825]: pgmap v476: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 1.21k op/s 2026-02-18T03:38:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:50 trial155 ceph-mon[87919]: pgmap v477: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 9.6 MiB/s rd, 9.7 MiB/s wr, 994 op/s 2026-02-18T03:38:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:50 trial034 ceph-mon[21825]: pgmap v477: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 9.6 MiB/s rd, 9.7 MiB/s wr, 994 op/s 2026-02-18T03:38:51.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:51.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 117.40 1.3M 1.3M 0.0k 12.5M 12.6M 0.0k nvme12n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 114.40 1.1M 1.3M 0.0k 11.5M 12.6M 0.0k nvme16n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 124.30 1.4M 1.2M 0.0k 13.6M 12.0M 0.0k nvme20n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 116.70 1.3M 1.2M 0.0k 12.7M 12.1M 0.0k nvme24n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 111.80 1.1M 1.2M 0.0k 11.1M 11.9M 0.0k nvme28n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 121.60 1.3M 1.3M 0.0k 12.7M 12.5M 0.0k nvme32n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 115.70 1.1M 1.2M 0.0k 11.4M 11.8M 0.0k nvme36n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 116.80 1.2M 1.2M 0.0k 12.2M 12.2M 0.0k nvme40n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 115.50 1.2M 1.3M 0.0k 11.6M 12.5M 0.0k nvme44n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 119.50 1.2M 1.3M 0.0k 12.0M 12.8M 0.0k nvme48n3 2026-02-18T03:38:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 125.20 1.4M 1.3M 0.0k 13.8M 12.9M 0.0k nvme4n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 112.90 1.3M 1.2M 0.0k 12.8M 12.1M 0.0k nvme52n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 112.50 1.2M 1.2M 0.0k 11.8M 11.8M 0.0k nvme56n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 115.60 1.1M 1.2M 0.0k 11.5M 11.6M 0.0k nvme60n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 115.30 1.2M 1.2M 0.0k 12.4M 11.9M 0.0k nvme64n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 120.80 1.2M 1.3M 0.0k 11.9M 12.9M 0.0k nvme8n3 2026-02-18T03:38:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:38:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:52 trial155 ceph-mon[87919]: pgmap v478: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2026-02-18T03:38:53.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:52 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3407698867' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:53.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:52 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3596413082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:52 trial034 ceph-mon[21825]: pgmap v478: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2026-02-18T03:38:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3407698867' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3596413082' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:38:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:54 trial155 ceph-mon[87919]: pgmap v479: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 19 MiB/s wr, 1.81k op/s 2026-02-18T03:38:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:54 trial034 ceph-mon[21825]: pgmap v479: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 19 MiB/s wr, 1.81k op/s 2026-02-18T03:38:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:56 trial155 ceph-mon[87919]: pgmap v480: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 24 MiB/s rd, 25 MiB/s wr, 2.39k op/s 2026-02-18T03:38:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:56 trial034 ceph-mon[21825]: pgmap v480: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 24 MiB/s rd, 25 MiB/s wr, 2.39k op/s 2026-02-18T03:38:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:58 trial155 ceph-mon[87919]: pgmap v481: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.59k op/s 2026-02-18T03:38:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:58 trial034 ceph-mon[21825]: pgmap v481: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.59k op/s 2026-02-18T03:39:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3502701949' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:38:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3718490345' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3502701949' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:00.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:38:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3718490345' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:00 trial155 ceph-mon[87919]: pgmap v482: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.93k op/s 2026-02-18T03:39:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:00 trial034 ceph-mon[21825]: pgmap v482: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.93k op/s 2026-02-18T03:39:01.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:01.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.0M 2.1M 0.0k 20.2M 21.2M 0.0k nvme12n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 191.30 2.0M 2.0M 0.0k 19.6M 20.4M 0.0k nvme16n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.1M 2.1M 0.0k 21.1M 20.5M 0.0k nvme20n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 188.70 1.9M 2.0M 0.0k 18.9M 19.7M 0.0k nvme24n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 188.40 1.9M 2.0M 0.0k 19.2M 19.9M 0.0k nvme28n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.0M 2.0M 0.0k 20.3M 20.4M 0.0k nvme32n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.80 1.9M 1.9M 0.0k 19.4M 18.8M 0.0k nvme36n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 2.0M 2.1M 0.0k 20.1M 20.6M 0.0k nvme40n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 189.00 1.9M 1.9M 0.0k 19.4M 19.3M 0.0k nvme44n3 2026-02-18T03:39:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.1M 2.0M 0.0k 20.6M 20.2M 0.0k nvme48n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 2.2M 2.0M 0.0k 21.7M 20.5M 0.0k nvme4n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 187.10 1.9M 2.0M 0.0k 19.0M 20.3M 0.0k nvme52n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 190.40 1.8M 2.0M 0.0k 18.4M 20.4M 0.0k nvme56n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 194.50 2.0M 2.0M 0.0k 20.1M 20.3M 0.0k nvme60n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.20 2.1M 2.0M 0.0k 20.7M 20.0M 0.0k nvme64n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 191.90 1.9M 2.0M 0.0k 19.2M 19.8M 0.0k nvme8n3 2026-02-18T03:39:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:02 trial155 ceph-mon[87919]: pgmap v483: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.91k op/s 2026-02-18T03:39:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:02 trial034 ceph-mon[21825]: pgmap v483: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.91k op/s 2026-02-18T03:39:05.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:04 trial155 ceph-mon[87919]: pgmap v484: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.35k op/s 2026-02-18T03:39:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:04 trial034 ceph-mon[21825]: pgmap v484: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.35k op/s 2026-02-18T03:39:07.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:06 trial155 ceph-mon[87919]: pgmap v485: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.19k op/s 2026-02-18T03:39:07.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1728906714' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:07.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/43290051' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:06 trial034 ceph-mon[21825]: pgmap v485: 33 pgs: 33 active+clean; 16 GiB data, 49 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 3.19k op/s 2026-02-18T03:39:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1728906714' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/43290051' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:08 trial155 ceph-mon[87919]: pgmap v486: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.15k op/s 2026-02-18T03:39:09.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:08 trial034 ceph-mon[21825]: pgmap v486: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.15k op/s 2026-02-18T03:39:11.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:10 trial155 ceph-mon[87919]: pgmap v487: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.11k op/s 2026-02-18T03:39:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:10 trial034 ceph-mon[21825]: pgmap v487: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.11k op/s 2026-02-18T03:39:11.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:11.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:11.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.0M 2.0M 0.0k 19.8M 19.8M 0.0k nvme12n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 2.2M 1.9M 0.0k 21.8M 19.3M 0.0k nvme16n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 187.40 1.7M 2.0M 0.0k 17.2M 19.6M 0.0k nvme20n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 1.9M 2.1M 0.0k 19.2M 20.5M 0.0k nvme24n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 1.9M 1.9M 0.0k 19.2M 19.5M 0.0k nvme28n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.0M 2.0M 0.0k 19.8M 19.5M 0.0k nvme32n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 190.00 1.8M 2.0M 0.0k 18.3M 19.6M 0.0k nvme36n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.1M 2.0M 0.0k 20.6M 20.4M 0.0k nvme40n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.0M 2.0M 0.0k 19.7M 20.3M 0.0k nvme44n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.0M 2.0M 0.0k 19.9M 19.9M 0.0k nvme48n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.0M 1.9M 0.0k 20.2M 19.3M 0.0k nvme4n3 2026-02-18T03:39:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 1.8M 2.0M 0.0k 18.5M 19.8M 0.0k nvme52n3 2026-02-18T03:39:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 188.80 1.8M 2.0M 0.0k 18.3M 19.8M 0.0k nvme56n3 2026-02-18T03:39:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 1.9M 1.9M 0.0k 19.1M 19.3M 0.0k nvme60n3 2026-02-18T03:39:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 189.60 1.9M 2.0M 0.0k 18.8M 20.3M 0.0k nvme64n3 2026-02-18T03:39:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 1.9M 2.0M 0.0k 18.9M 19.6M 0.0k nvme8n3 2026-02-18T03:39:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:12 trial155 ceph-mon[87919]: pgmap v488: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 30 MiB/s wr, 2.90k op/s 2026-02-18T03:39:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:12 trial034 ceph-mon[21825]: pgmap v488: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 30 MiB/s wr, 2.90k op/s 2026-02-18T03:39:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3057659816' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:14.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/799784882' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:14.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3057659816' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:14.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/799784882' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:15.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:14 trial155 ceph-mon[87919]: pgmap v489: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:39:15.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:14 trial034 ceph-mon[21825]: pgmap v489: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:39:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:16 trial155 ceph-mon[87919]: pgmap v490: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.20k op/s 2026-02-18T03:39:17.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:16 trial034 ceph-mon[21825]: pgmap v490: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.20k op/s 2026-02-18T03:39:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:18 trial155 ceph-mon[87919]: pgmap v491: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.15k op/s 2026-02-18T03:39:19.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:18 trial034 ceph-mon[21825]: pgmap v491: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.15k op/s 2026-02-18T03:39:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:20 trial155 ceph-mon[87919]: pgmap v492: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.12k op/s 2026-02-18T03:39:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1207550205' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1798643153' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:20 trial034 ceph-mon[21825]: pgmap v492: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.12k op/s 2026-02-18T03:39:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1207550205' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:20 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1798643153' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:21.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 1.9M 1.9M 0.0k 19.5M 18.8M 0.0k nvme12n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.0M 1.9M 0.0k 20.1M 19.2M 0.0k nvme16n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 1.9M 1.8M 0.0k 19.2M 18.3M 0.0k nvme20n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.0M 2.0M 0.0k 19.8M 19.7M 0.0k nvme24n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 193.10 2.0M 1.8M 0.0k 19.8M 18.1M 0.0k nvme28n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 1.8M 1.8M 0.0k 18.4M 18.2M 0.0k nvme32n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.20 2.0M 1.9M 0.0k 20.5M 18.9M 0.0k nvme36n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 191.90 1.8M 1.9M 0.0k 18.2M 19.1M 0.0k nvme40n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.0M 1.9M 0.0k 19.6M 19.3M 0.0k nvme44n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.30 2.0M 1.9M 0.0k 19.6M 18.6M 0.0k nvme48n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.0M 2.0M 0.0k 20.1M 20.2M 0.0k nvme4n3 2026-02-18T03:39:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 191.50 1.9M 1.9M 0.0k 19.1M 19.4M 0.0k nvme52n3 2026-02-18T03:39:21.742 INFO:tasks.workunit.client.0.trial014.stdout: 193.20 2.0M 1.9M 0.0k 19.6M 19.3M 0.0k nvme56n3 2026-02-18T03:39:21.742 INFO:tasks.workunit.client.0.trial014.stdout: 193.20 1.8M 1.8M 0.0k 18.5M 18.4M 0.0k nvme60n3 2026-02-18T03:39:21.742 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.0M 1.9M 0.0k 20.0M 19.2M 0.0k nvme64n3 2026-02-18T03:39:21.742 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.0M 1.9M 0.0k 20.4M 19.0M 0.0k nvme8n3 2026-02-18T03:39:21.742 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:22 trial155 ceph-mon[87919]: pgmap v493: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 2.91k op/s 2026-02-18T03:39:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:22 trial034 ceph-mon[21825]: pgmap v493: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 2.91k op/s 2026-02-18T03:39:25.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:24 trial155 ceph-mon[87919]: pgmap v494: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.37k op/s 2026-02-18T03:39:25.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:24 trial034 ceph-mon[21825]: pgmap v494: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.37k op/s 2026-02-18T03:39:27.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:26 trial155 ceph-mon[87919]: pgmap v495: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.23k op/s 2026-02-18T03:39:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:26 trial034 ceph-mon[21825]: pgmap v495: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.23k op/s 2026-02-18T03:39:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:27 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1727445291' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:28.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:27 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1798630397' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:28.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1727445291' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:28.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:27 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1798630397' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:29.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:28 trial155 ceph-mon[87919]: pgmap v496: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 30 MiB/s wr, 3.18k op/s 2026-02-18T03:39:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:28 trial034 ceph-mon[21825]: pgmap v496: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 30 MiB/s wr, 3.18k op/s 2026-02-18T03:39:31.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:30 trial155 ceph-mon[87919]: pgmap v497: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:39:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:30 trial034 ceph-mon[21825]: pgmap v497: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:39:31.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 1.9M 1.8M 0.0k 18.9M 18.3M 0.0k nvme12n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 1.8M 1.8M 0.0k 18.5M 18.4M 0.0k nvme16n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.0M 1.8M 0.0k 19.7M 18.3M 0.0k nvme20n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.40 1.8M 1.9M 0.0k 18.3M 18.8M 0.0k nvme24n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 1.8M 1.9M 0.0k 17.9M 19.1M 0.0k nvme28n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 1.8M 1.8M 0.0k 17.8M 18.3M 0.0k nvme32n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.90 1.9M 1.8M 0.0k 19.0M 18.3M 0.0k nvme36n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 1.9M 1.8M 0.0k 18.8M 18.2M 0.0k nvme40n3 2026-02-18T03:39:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 1.8M 1.8M 0.0k 18.3M 18.2M 0.0k nvme44n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.90 1.8M 1.8M 0.0k 17.9M 18.5M 0.0k nvme48n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.00 1.9M 1.8M 0.0k 18.9M 18.3M 0.0k nvme4n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 1.8M 1.9M 0.0k 18.4M 19.4M 0.0k nvme52n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.30 1.7M 1.8M 0.0k 17.4M 18.4M 0.0k nvme56n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 1.9M 1.9M 0.0k 19.0M 19.4M 0.0k nvme60n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.0M 1.9M 0.0k 19.8M 19.0M 0.0k nvme64n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.80 1.8M 1.8M 0.0k 18.4M 18.3M 0.0k nvme8n3 2026-02-18T03:39:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:33.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:32 trial155 ceph-mon[87919]: pgmap v498: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 27 MiB/s wr, 2.93k op/s 2026-02-18T03:39:33.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:32 trial034 ceph-mon[21825]: pgmap v498: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 27 MiB/s wr, 2.93k op/s 2026-02-18T03:39:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:34 trial155 ceph-mon[87919]: pgmap v499: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:39:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2008112399' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1751989161' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:34 trial034 ceph-mon[21825]: pgmap v499: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:39:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2008112399' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:34 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1751989161' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:37.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:36 trial155 ceph-mon[87919]: pgmap v500: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.23k op/s 2026-02-18T03:39:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:36 trial034 ceph-mon[21825]: pgmap v500: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.23k op/s 2026-02-18T03:39:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:38 trial155 ceph-mon[87919]: pgmap v501: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.16k op/s 2026-02-18T03:39:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:38 trial034 ceph-mon[21825]: pgmap v501: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.16k op/s 2026-02-18T03:39:39.908 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:39:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: pgmap v502: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.15k op/s 2026-02-18T03:39:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:39:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:39:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:39:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:40 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:39:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: pgmap v502: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.15k op/s 2026-02-18T03:39:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:39:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:39:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:39:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:40 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:39:41.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 191.70 1.7M 1.7M 0.0k 16.9M 17.0M 0.0k nvme12n3 2026-02-18T03:39:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 1.8M 1.9M 0.0k 18.0M 18.8M 0.0k nvme16n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 1.8M 1.7M 0.0k 17.6M 17.1M 0.0k nvme20n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 1.8M 1.8M 0.0k 17.9M 18.1M 0.0k nvme24n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 2.0M 1.8M 0.0k 19.6M 18.2M 0.0k nvme28n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 1.8M 1.8M 0.0k 17.9M 17.8M 0.0k nvme32n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 1.9M 1.8M 0.0k 18.8M 18.2M 0.0k nvme36n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.70 1.9M 1.9M 0.0k 19.4M 18.6M 0.0k nvme40n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.70 1.8M 1.7M 0.0k 17.6M 16.6M 0.0k nvme44n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 1.9M 1.8M 0.0k 19.1M 17.9M 0.0k nvme48n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.30 1.8M 1.8M 0.0k 18.0M 17.6M 0.0k nvme4n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 1.9M 1.7M 0.0k 19.0M 17.5M 0.0k nvme52n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.10 1.7M 1.8M 0.0k 17.4M 17.7M 0.0k nvme56n3 2026-02-18T03:39:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 1.9M 1.9M 0.0k 19.0M 18.9M 0.0k nvme60n3 2026-02-18T03:39:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 1.8M 1.9M 0.0k 18.4M 18.6M 0.0k nvme64n3 2026-02-18T03:39:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 1.8M 1.8M 0.0k 18.3M 17.7M 0.0k nvme8n3 2026-02-18T03:39:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:42.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2470253858' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:42.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1525304610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2470253858' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1525304610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:42 trial034 ceph-mon[21825]: pgmap v503: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.93k op/s 2026-02-18T03:39:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:42 trial155 ceph-mon[87919]: pgmap v503: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.93k op/s 2026-02-18T03:39:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:44 trial034 ceph-mon[21825]: pgmap v504: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.38k op/s 2026-02-18T03:39:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:44 trial155 ceph-mon[87919]: pgmap v504: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.38k op/s 2026-02-18T03:39:47.269 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #4: thrashed- nvmeof.b, nvmeof.d (by ceph_daemon_stop); 2026-02-18T03:39:47.270 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:39:47.270 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:39:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:46 trial034 ceph-mon[21825]: pgmap v505: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 3min 54s ago 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:39:47.299 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 340.5M (peak: 343.9M) 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 15min 30.551s 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:39:47.300 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.729867] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000140 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.745897] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000167 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.769891] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000154 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.785910] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000165 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.801929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000192 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.817955] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000208 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.833958] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000208 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.849947] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000180 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.865973] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000216 seconds 2026-02-18T03:39:47.301 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:38:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:38:45.881935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000173 seconds 2026-02-18T03:39:47.303 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:39:47.344 INFO:teuthology.orchestra.run.trial086.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:47.344 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:39:47.344 INFO:teuthology.orchestra.run.trial086.stdout: Active: inactive (dead) since Wed 2026-02-18 03:38:27 UTC; 1min 20s ago 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Duration: 2min 26.767s 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86275 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Process: 86276 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Process: 97646 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Process: 97854 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Process: 97890 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 86357 (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 9min 46.775s 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:39:47.345 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[86357]: [18-Feb-2026 03:38:27] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 podman[97669]: 2026-02-18 03:38:27.189892395 +0000 UTC m=+3.823392160 container died c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, release=, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, version=1.6.5, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.nvmeof=, org.centos.version=9.0-30.el9, io.ceph.component=ceph-nvmeof, io.spdk.version=25.09, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.openshift.wants=ceph,rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, architecture=x86_64) 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 podman[97669]: 2026-02-18 03:38:27.202904457 +0000 UTC m=+3.836404232 container remove c572dc4418fe185e4064695545076366d604b2e6b316543fc3991b5b7ae2b0a7 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.spdk.build.makeflags=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.ceph.version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, build-date=2026-02-11 09:53:49 UTC, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, name=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, release=, url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, io.ceph.nvmeof=, io.spdk.git.branch=undefined, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.6.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 bash[97669]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Deactivated successfully. 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:39:47.346 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:38:27 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 9min 46.775s CPU time, 330.0M memory peak. 2026-02-18T03:39:47.347 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:39:47.348 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:39:47.371 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:46 trial155 ceph-mon[87919]: pgmap v505: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:39:47.380 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:47.380 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:39:47.380 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 5min ago 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 367.5M (peak: 369.7M) 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 22min 28.442s 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.381 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.712545] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000195 seconds 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.728593] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000194 seconds 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.752610] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000215 seconds 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.768618] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000212 seconds 2026-02-18T03:39:47.382 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.784592] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000181 seconds 2026-02-18T03:39:47.383 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.800663] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000264 seconds 2026-02-18T03:39:47.383 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.816631] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000219 seconds 2026-02-18T03:39:47.383 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.844705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000257 seconds 2026-02-18T03:39:47.383 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.860644] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000215 seconds 2026-02-18T03:39:47.383 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:38:45 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:38:45.872638] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000212 seconds 2026-02-18T03:39:47.384 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:39:47.415 INFO:teuthology.orchestra.run.trial177.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:47.415 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:39:47.415 INFO:teuthology.orchestra.run.trial177.stdout: Active: inactive (dead) since Wed 2026-02-18 03:38:39 UTC; 1min 7s ago 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Duration: 2min 40.025s 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51439 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Process: 51440 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Process: 62974 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63047 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63084 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 51517 (code=exited, status=0/SUCCESS) 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 10min 58.319s 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:39:47.416 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[51517]: [18-Feb-2026 03:38:39] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 podman[63008]: 2026-02-18 03:38:39.887917656 +0000 UTC m=+1.410171234 container died aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.nvmeof=, build-date=2026-02-11 09:53:49 UTC, vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, release=, name=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.ceph.version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, summary=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.component=ubi9-container, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public) 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 podman[63008]: 2026-02-18 03:38:39.902114431 +0000 UTC m=+1.424368009 container remove aafd1145cff683e012e22957e7e5ded125dbd2d906a2d9732b9fab7b65d3bf2f (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-type=git, build-date=2026-02-11 09:53:49 UTC, maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, io.spdk.build.target-arch=x86-64-v2, name=ceph-nvmeof, io.spdk.version=25.09, io.spdk.build.makeflags=, architecture=x86_64, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, io.ceph.nvmeof=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.openshift.wants=ceph,rbd, version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc.) 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 bash[63008]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:39:47.417 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:38:39 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 10min 58.319s CPU time, 356.6M memory peak. 2026-02-18T03:39:47.418 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:39:47.418 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:39:47.636 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:39:47.637 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 2m ago 14m trial034=x;count:1 2026-02-18T03:39:47.637 INFO:teuthology.orchestra.run.trial177.stdout:mon 2/3 5m ago 15m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:39:47.637 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 2/4 5m ago 13m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:39:47.637 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 5m ago 13m trial155 2026-02-18T03:39:47.645 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:39:47.823 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:39:47.824 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (3m) 2m ago 3m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:39:47.824 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 stopped 67s ago 3m - - 2026-02-18T03:39:47.824 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (5m) 5m ago 9m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:39:47.824 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 stopped 67s ago 3m - - 2026-02-18T03:39:47.832 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:39:48.051 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,c; 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:48.051 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,c 2026-02-18T03:39:48.051 INFO:teuthology.orchestra.run.trial177.stdout: mon.b (rank 2) addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] is down (out of quorum) 2026-02-18T03:39:48.051 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:48.052 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:39:48.059 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,c 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:39:48.274 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c (age 70s) [leader: a], out of quorum: b 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 15m) 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 13m), 8 in (since 13m) 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 2 gateways active (2 hosts) 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: usage: 51 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:39:48.275 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:39:48.276 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:39:48.276 INFO:teuthology.orchestra.run.trial177.stdout: client: 29 MiB/s rd, 29 MiB/s wr, 1.60k op/s rd, 1.58k op/s wr 2026-02-18T03:39:48.276 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:39:48.281 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:39:48.520 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:39:48.520 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 176, 2026-02-18T03:39:48.520 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:39:48.520 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:39:48.520 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 4, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 97, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:39:48.521 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:39:48.522 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: ACTIVE " 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:39:48.523 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "CREATED", 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:39:48.524 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:39:48.528 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.586 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.587 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.588 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.589 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.590 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.591 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:39:48.593 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:39:48.639 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.640 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:39:48.685 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.685 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:39:48.729 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.730 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:39:48.774 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.775 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:39:48.819 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.819 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:39:48.864 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.864 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:39:48.908 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.908 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:39:48.953 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:48.954 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:39:48.999 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.000 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:39:49.044 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.045 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:39:49.089 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.090 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:39:49.134 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.135 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:39:49.180 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.181 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:39:49.225 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.226 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.84520 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.84526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: pgmap v506: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.18k op/s 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/680949535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1801672306' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3663773386' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1868669006' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:49.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2712874108' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:39:49.273 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.273 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:39:49.317 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.319 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:39:49.365 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.365 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:39:49.410 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.410 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:39:49.455 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.455 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.84520 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.84526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: pgmap v506: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.18k op/s 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/680949535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1801672306' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3663773386' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1868669006' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/2712874108' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:39:49.500 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.500 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:39:49.544 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.544 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:39:49.589 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.590 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:39:49.634 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.635 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:39:49.680 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.681 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:39:49.725 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.726 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:39:49.770 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.772 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:39:49.817 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.817 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:39:49.862 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.864 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:39:49.909 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.909 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:39:49.993 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:49.994 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:39:50.038 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.039 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:39:50.083 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.084 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:39:50.129 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.130 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:39:50.174 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.175 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:39:50.242 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.243 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:39:50.286 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.287 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:39:50.371 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.372 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:39:50.458 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.459 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:39:50.504 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.504 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:39:50.550 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.550 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:39:50.596 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.597 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:39:50.642 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.642 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:39:50.687 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.688 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:39:50.733 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.734 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:39:50.778 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.779 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:39:50.823 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.823 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:39:50.908 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.909 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:39:50.953 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.954 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:39:50.998 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:50.998 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:39:51.042 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.042 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:39:51.086 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.086 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:39:51.131 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.131 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:39:51.176 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.176 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:39:51.220 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.221 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:39:51.264 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.265 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:39:51.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:50 trial034 ceph-mon[21825]: pgmap v507: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.17k op/s 2026-02-18T03:39:51.310 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.311 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:39:51.357 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.358 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:39:51.403 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.404 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:39:51.450 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.450 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:39:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:50 trial155 ceph-mon[87919]: pgmap v507: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.17k op/s 2026-02-18T03:39:51.495 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.496 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:39:51.541 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.542 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:39:51.587 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.588 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:39:51.635 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.635 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:39:51.680 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:39:51.681 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:39:51.681 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:39:51.681 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.b 2026-02-18T03:39:51.681 DEBUG:teuthology.orchestra.run.trial086:> ceph orch daemon restart nvmeof.nvmeof.b --force 2026-02-18T03:39:51.681 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:39:51.681 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.b 2026-02-18T03:39:51.682 INFO:tasks.cephadm.mon.c:Restarting mon.b (starting--it wasn't running)... 2026-02-18T03:39:51.682 DEBUG:teuthology.orchestra.run.trial086:mon.b> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service 2026-02-18T03:39:51.684 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b 2026-02-18T03:39:51.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 1.8M 1.7M 0.0k 18.1M 17.4M 0.0k nvme12n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 1.8M 1.8M 0.0k 18.1M 17.6M 0.0k nvme16n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 1.8M 1.8M 0.0k 17.6M 18.0M 0.0k nvme20n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 191.20 1.7M 1.8M 0.0k 16.9M 18.2M 0.0k nvme24n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 193.80 1.7M 1.8M 0.0k 16.6M 17.7M 0.0k nvme28n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 203.80 2.4M 2.4M 0.0k 24.4M 24.2M 0.0k nvme32n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 1.9M 1.8M 0.0k 18.9M 17.7M 0.0k nvme36n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 1.9M 1.8M 0.0k 18.6M 18.1M 0.0k nvme40n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 1.8M 1.7M 0.0k 17.7M 17.4M 0.0k nvme44n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 1.8M 1.8M 0.0k 17.8M 17.9M 0.0k nvme48n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 1.7M 1.8M 0.0k 17.3M 17.8M 0.0k nvme4n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 1.8M 1.8M 0.0k 17.8M 18.4M 0.0k nvme52n3 2026-02-18T03:39:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 1.9M 1.8M 0.0k 18.6M 18.2M 0.0k nvme56n3 2026-02-18T03:39:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 192.40 1.8M 1.8M 0.0k 17.6M 17.6M 0.0k nvme60n3 2026-02-18T03:39:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.0M 1.9M 0.0k 19.6M 19.3M 0.0k nvme64n3 2026-02-18T03:39:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 193.00 1.8M 1.8M 0.0k 17.5M 18.2M 0.0k nvme8n3 2026-02-18T03:39:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:39:51.890 INFO:teuthology.orchestra.run.trial086.stdout:Scheduled to restart nvmeof.nvmeof.b on host 'trial086' 2026-02-18T03:39:51.901 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.d 2026-02-18T03:39:51.901 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon restart nvmeof.nvmeof.d --force 2026-02-18T03:39:51.910 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:39:51.910 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:39:52.087 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to restart nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:39:52.095 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 82 secs before thrashing 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 systemd[1]: Starting Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 podman[98506]: 2026-02-18 03:39:51.865219208 +0000 UTC m=+0.019158058 container create 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 podman[98506]: 2026-02-18 03:39:51.900484487 +0000 UTC m=+0.054423347 container init 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7) 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 podman[98506]: 2026-02-18 03:39:51.90328175 +0000 UTC m=+0.057220610 container start 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 bash[98506]: 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 podman[98506]: 2026-02-18 03:39:51.858153204 +0000 UTC m=+0.012092064 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 systemd[1]: Started Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:39:52.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: pidfile_write: ignore empty --pid-file 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: load: jerasure load: lrc 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Git sha 0 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: DB SUMMARY 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: DB Session ID: WNXBAMICKULQ74F6OZTZ 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: MANIFEST file: MANIFEST-000023 size: 1491 Bytes 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000040.sst 2026-02-18T03:39:52.126 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000038.log size: 758684 ; 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.env: 0x55d06be3f100 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.info_log: 0x55d071a92e80 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.statistics: (nil) 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.use_fsync: 0 2026-02-18T03:39:52.127 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.db_log_dir: 2026-02-18T03:39:52.128 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.wal_dir: 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.write_buffer_manager: 0x55d071a96b40 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:39:52.129 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.unordered_write: 0 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.row_cache: None 2026-02-18T03:39:52.130 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.wal_filter: None 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.wal_compression: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:39:52.131 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:39:52.132 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_open_files: -1 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Compression algorithms supported: 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kZSTD supported: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:39:52.133 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000023 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.merge_operator: 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_filter: None 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:39:52.134 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d071a923c0) 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: index_type: 0 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: data_block_index_type: 0 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: index_shortening: 1 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: checksum: 4 2026-02-18T03:39:52.135 INFO:journalctl@ceph.mon.b.trial086.stdout: no_block_cache: 0 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache: 0x55d071ab3b90 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_options: 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: capacity : 536870912 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: num_shard_bits : 4 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: strict_capacity_limit : 0 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_cache_compressed: (nil) 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: persistent_cache: (nil) 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_size: 4096 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_size_deviation: 10 2026-02-18T03:39:52.136 INFO:journalctl@ceph.mon.b.trial086.stdout: block_restart_interval: 16 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: index_block_restart_interval: 1 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: metadata_block_size: 4096 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: partition_filters: 0 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: use_delta_encoding: 1 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: filter_policy: bloomfilter 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: whole_key_filtering: 1 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: verify_compression: 0 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: format_version: 5 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_index_compression: 1 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: block_align: 0 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: max_auto_readahead_size: 262144 2026-02-18T03:39:52.137 INFO:journalctl@ceph.mon.b.trial086.stdout: prepopulate_block_cache: 0 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression: NoCompression 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.num_levels: 7 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:39:52.138 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:39:52.139 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:39:52.140 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:39:52.141 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:39:52.142 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.ttl: 2592000 2026-02-18T03:39:52.143 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:39:52.144 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000023 succeeded,manifest_file_number is 23, next_file_number is 42, last_sequence is 17940, log_number is 38,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 38 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 38 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43e7e096-cb3c-4269-9323-0b4ac0e3cc86 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385991935161, "job": 1, "event": "recovery_started", "wal_files": [38]} 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #38 mode 2 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385991937662, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 43, "file_size": 496944, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 17945, "largest_seqno": 18552, "table_properties": {"data_size": 493810, "index_size": 1519, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 4840, "raw_average_key_size": 21, "raw_value_size": 489052, "raw_average_value_size": 2183, "num_data_blocks": 68, "num_entries": 224, "num_filter_entries": 224, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771385991, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43e7e096-cb3c-4269-9323-0b4ac0e3cc86", "db_session_id": "WNXBAMICKULQ74F6OZTZ", "orig_file_number": 43, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771385991937731, "job": 1, "event": "recovery_finished"} 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:5047] Creating manifest 45 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000038.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d071ab6700 2026-02-18T03:39:52.145 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: DB pointer 0x55d071ac8000 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: ** DB Stats ** 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.146 INFO:journalctl@ceph.mon.b.trial086.stdout: ** Compaction Stats [default] ** 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: L0 1/0 485.30 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 342.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: L6 1/0 7.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: Sum 2/0 7.93 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 342.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 342.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: ** Compaction Stats [default] ** 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 342.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:39:52.147 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Cumulative compaction: 0.00 GB write, 96.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Interval compaction: 0.00 GB write, 96.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:39:52.148 INFO:journalctl@ceph.mon.b.trial086.stdout: Block cache BinnedLRUCache@0x55d071ab3b90#2 capacity: 512.00 MB usage: 2.24 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012666%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: starting mon.b rank 2 at public addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] at bind addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).mds e1 new map 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).mds e1 print_map 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: e1 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:39:52.149 INFO:journalctl@ceph.mon.b.trial086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout: legacy client fscid: -1 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout: 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout: No filesystems configured 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).osd e55 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).osd e55 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).osd e55 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).osd e55 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:39:52.150 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:51 trial086 ceph-mon[98535]: mon.b@-1(???).paxosservice(auth 1..41) refresh upgraded, format 0 -> 3 2026-02-18T03:39:52.266 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:39:52.281 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:39:52.281 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:39:52.281 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:39:52.358 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 941782, 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:39:52.359 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:52.360 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:52.361 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.362 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:52.363 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.364 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:39:52.365 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:52.366 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.367 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.368 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:52.369 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.370 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:52.371 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.372 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.373 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:52.374 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "num": 7 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "num": 76 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:39:52.375 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:39:52.376 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:39:52.378 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:39:52.378 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:39:52.378 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:39:52.421 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 systemd[1]: Starting Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:39:52.421 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 podman[98786]: 2026-02-18 03:39:52.392415534 +0000 UTC m=+0.018118003 container create 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, release=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.ceph.version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.makeflags=, name=ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.ceph.nvmeof=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.branch=undefined, vendor=Red Hat, Inc., io.spdk.build.target-arch=x86-64-v2, org.centos.version=9.0-30.el9, io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, distribution-scope=public, maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.openshift.wants=ceph,rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.buildah.version=1.29.0, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git) 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2470253858' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1525304610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: pgmap v503: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.93k op/s 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: pgmap v504: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.38k op/s 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: pgmap v505: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.84520 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.84526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:39:52.422 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: pgmap v506: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.18k op/s 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/680949535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1801672306' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3663773386' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1868669006' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2712874108' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:39:52.423 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-mon[98535]: pgmap v507: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.17k op/s 2026-02-18T03:39:52.857 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 systemd[1]: Starting Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:39:52.857 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 podman[63815]: 2026-02-18 03:39:52.828363031 +0000 UTC m=+0.018011477 container create 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, name=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, org.centos.version=9.0-30.el9, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, distribution-scope=public, io.spdk.build.target-arch=x86-64-v2, vendor=Red Hat, Inc., release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, architecture=x86_64, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.version=25.09, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.buildah.version=1.29.0, io.ceph.component=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.6.5, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=, version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers , io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.branch=devel) 2026-02-18T03:39:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 podman[98786]: 2026-02-18 03:39:52.423220516 +0000 UTC m=+0.048922985 container init 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.makeflags=, io.spdk.git.branch=undefined, io.spdk.build.ceph-release=20.2.0, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, release=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.version=9.0-30.el9, distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.spdk.version=25.09, io.ceph.nvmeof=) 2026-02-18T03:39:52.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 podman[98786]: 2026-02-18 03:39:52.425236716 +0000 UTC m=+0.050939185 container start 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.spdk.build.target-arch=x86-64-v2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, io.ceph.component=ceph-nvmeof, vendor=Red Hat, Inc., org.centos.version=9.0-30.el9, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, version=1.6.5, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.spdk.version=25.09, io.ceph.version=1.6.5, io.ceph.git.branch=devel, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.wants=ceph,rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2026-02-11 09:53:49 UTC, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.branch=undefined) 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 bash[98786]: 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 podman[98786]: 2026-02-18 03:39:52.385097802 +0000 UTC m=+0.010800271 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 systemd[1]: Started Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b, using rotation 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:39:52.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [gateway] 2026-02-18T03:39:52.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): name = client.nvmeof.nvmeof.b 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): port = 5500 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:39:52.876 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:39:52.877 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:39:52.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:39:52.878 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:39:52.879 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): force_tls = False 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.880 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.881 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [discovery] 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): addr = 10.20.193.86 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): port = 8009 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [ceph] 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): pool = mypool 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): id = nvmeof.nvmeof.b 2026-02-18T03:39:52.882 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [mtls] 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [spdk] 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:39:52.883 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): transports = tcp 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): [monitor] 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:39:52.884 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.b 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:39:52.885 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:52] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.86:5499 for group id 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 podman[63815]: 2026-02-18 03:39:52.858145885 +0000 UTC m=+0.047794331 container init 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, build-date=2026-02-11 09:53:49 UTC, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, vcs-type=git, org.centos.version=9.0-30.el9, maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.maintainer=Ceph Developers , release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.component=ceph-nvmeof, io.spdk.build.target-arch=x86-64-v2, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, name=ceph-nvmeof, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, distribution-scope=public, architecture=x86_64, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09) 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 podman[63815]: 2026-02-18 03:39:52.860277858 +0000 UTC m=+0.049926294 container start 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, vendor=Red Hat, Inc., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.nvmeof=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, version=1.6.5, io.spdk.version=25.09, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.target-arch=x86-64-v2, org.centos.version=9.0-30.el9, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, distribution-scope=public, io.spdk.build.ceph-release=20.2.0, io.ceph.component=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=, vcs-type=git, architecture=x86_64, io.ceph.version=1.6.5, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, com.redhat.component=ubi9-container, io.spdk.build.makeflags=, io.ceph.git.branch=devel, name=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers ) 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 bash[63815]: 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 podman[63815]: 2026-02-18 03:39:52.820416882 +0000 UTC m=+0.010065338 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:52 trial177 systemd[1]: Started Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:39:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:39:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [gateway] 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:39:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): port = 5500 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:39:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:39:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:39:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): force_tls = False 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:39:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [discovery] 2026-02-18T03:39:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): port = 8009 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [ceph] 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): pool = mypool 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [mtls] 2026-02-18T03:39:53.223 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [spdk] 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:39:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): transports = tcp 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): [monitor] 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:39:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:39:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:53] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.177:5499 for group id 2026-02-18T03:39:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:39:53.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 15m) 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1257740078' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:39:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: mon.b calling monitor election 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: mon.a calling monitor election 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: monmap epoch 3 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: min_mon_release 20 (tentacle) 2026-02-18T03:39:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: election_strategy: 1 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: fsmap 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: mgrmap e15: x(active, since 15m) 2026-02-18T03:39:53.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1257740078' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:53.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:53 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:39:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: mon.b calling monitor election 2026-02-18T03:39:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: mon.a calling monitor election 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: monmap epoch 3 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: min_mon_release 20 (tentacle) 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: election_strategy: 1 2026-02-18T03:39:53.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: fsmap 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: mgrmap e15: x(active, since 15m) 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:39:53.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: NVMeoF Gateway 'client.nvmeof.nvmeof.b' is unavailable. 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1257740078' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:53.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:53 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.b group id=1 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:39:53.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:53 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:53] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:39:54.462 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.462 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:39:54.463 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-mon[21825]: pgmap v509: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.41k op/s 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:39:54.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:39:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:39:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:39:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:39:54.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:54] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:39:54.465 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.465 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.465 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.465 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.465 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:39:54.466 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:39:54.466 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.466 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:39:54.466 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-mon[87919]: pgmap v509: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.41k op/s 2026-02-18T03:39:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:39:54.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:39:54.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:39:54.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:39:54.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:54 trial086 ceph-mon[98535]: pgmap v509: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.41k op/s 2026-02-18T03:39:54.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:39:54] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:39:54.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:39:54.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:39:54.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:39:54.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:39:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:58544 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:39:54] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:39:54.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:39:54.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:39:54.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:39:54.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:37832 2026-02-18T03:39:55.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2319099247' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3835177280' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.745 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2319099247' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.746 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3835177280' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: INFO: Setting log level to WARNING 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.478937] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.478985] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:39:55.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.594037] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.617230] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.617239] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.617248] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.617249] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:39:55.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.744874] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:39:55.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:55 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2319099247' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:55 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3835177280' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:55.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:39:55] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:39:55.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:39:55] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:39:55.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:39:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:39:55] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:39:56.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:39:56.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO discovery.py:369 (81): discovery addr: 10.20.193.86 port: 8009 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.792214] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:55.792250] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial086). 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial086). 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO state.py:2073 (81): Initialization is over (discovery-trial086). 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO cephutils.py:308 (2): Registered nvmeof.b to service_map! 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:39:56.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:39:56.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:39:56.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:55] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:39:56.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.252 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:39:56.252 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.252 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.253 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.109531] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.86:0/2548113074, rc 0 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.109607] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.86:0/2548113074 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.86:0/2548113074' 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.121686] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.126374] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.126621] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.126636] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.238662] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.86:0/1499226014, rc 0 2026-02-18T03:39:56.254 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.238713] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.86:0/1499226014 2026-02-18T03:39:56.255 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.86:0/1499226014' 2026-02-18T03:39:56.255 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.250014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.255 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:39:56.395 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: INFO: Setting log level to WARNING 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.126376] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.126531] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.243042] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.267972] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.267982] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.267992] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:39:56.396 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.267993] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:39:56.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:39:56.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:39:56.397 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.394541] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:39:56.564 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:39:56.564 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:39:56.565 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3798717340' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.565 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1291656729' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.565 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: pgmap v510: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.13k op/s 2026-02-18T03:39:56.565 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3256936002' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.565 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4052413667' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.255179] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.255200] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.355256] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.86:0/2056761764, rc 0 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.355307] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.86:0/2056761764 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.86:0/2056761764' 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.367864] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:39:56.566 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.372263] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.372282] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.476462] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.86:0/1949092113, rc 0 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.476519] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.86:0/1949092113 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.86:0/1949092113' 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.488326] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.492885] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.492905] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:56.567 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.568 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.648 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:39:56.648 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:39:56.648 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO discovery.py:369 (81): discovery addr: 10.20.193.177 port: 8009 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:39:56.649 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.441797] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.441826] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial177). 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial177). 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO state.py:2073 (81): Initialization is over (discovery-trial177). 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.650 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.651 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.652 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:39:56.653 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: Cluster is now healthy 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3798717340' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1291656729' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: pgmap v510: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.13k op/s 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3256936002' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4052413667' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: Cluster is now healthy 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3798717340' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1291656729' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: pgmap v510: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.13k op/s 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3256936002' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:39:56.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:56 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4052413667' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:39:56.835 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.597263] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.86:0/2043086883, rc 0 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.597319] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.86:0/2043086883 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.86:0/2043086883' 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.608793] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.613388] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.613409] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.713479] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.86:0/4223155489, rc 0 2026-02-18T03:39:56.836 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.713539] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.86:0/4223155489 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.86:0/4223155489' 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.725516] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.730176] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.730198] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.834487] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.86:0/2655679568, rc 0 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.834623] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.86:0/2655679568 2026-02-18T03:39:56.837 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.86:0/2655679568' 2026-02-18T03:39:56.906 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:39:56.906 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.907 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.755284] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.177:0/1164626635, rc 0 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.755350] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.177:0/1164626635 2026-02-18T03:39:56.908 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.177:0/1164626635' 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.774331] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.778865] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.779148] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.779162] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.891577] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.177:0/2343407335, rc 0 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.891628] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.177:0/2343407335 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.177:0/2343407335' 2026-02-18T03:39:56.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.905530] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.059 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 5118, 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:39:57.060 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 4, 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.061 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.062 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.063 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:39:57.064 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.065 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.066 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:39:57.067 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:39:57.068 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.069 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.070 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.071 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:57.072 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.073 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:39:57.074 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:39:57.075 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:39:57.075 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:39:57.075 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:39:57.093 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.847625] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.856795] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.856818] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.956392] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.86:0/2304307276, rc 0 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.956454] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.86:0/2304307276 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.86:0/2304307276' 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.968619] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:39:57.094 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.988848] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:56.988878] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.080635] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.86:0/3565548933, rc 0 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.080703] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.86:0/3565548933 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.86:0/3565548933' 2026-02-18T03:39:57.095 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.092421] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.150 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 163491, 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:39:57.151 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 4, 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.152 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.153 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.154 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:39:57.155 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:39:57.156 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:39:57.157 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.158 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.159 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.160 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.161 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:39:57.162 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:39:57.163 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:39:57.164 INFO:teuthology.orchestra.run.trial034.stdout: "num": 9 2026-02-18T03:39:57.165 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:39:57.165 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:39:57.165 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:39:57.165 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:39:57.165 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:39:57.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:39:57.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.910696] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:39:57.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:56.910717] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:57.166 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:56] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.018955] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.177:0/1662505251, rc 0 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.019007] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.177:0/1662505251 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.177:0/1662505251' 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.030775] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.035329] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.035349] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.167 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.147334] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.177:0/3408527374, rc 0 2026-02-18T03:39:57.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.147388] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.177:0/3408527374 2026-02-18T03:39:57.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.177:0/3408527374' 2026-02-18T03:39:57.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.161753] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.168 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:39:57.169 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:39:57.169 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:39:57.169 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:39:57.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.097005] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.097029] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.192906] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.86:0/3035832901, rc 0 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.193618] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.86:0/3035832901 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.86:0/3035832901' 2026-02-18T03:39:57.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.206716] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.211278] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.211300] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.303098] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.86:0/3054698889, rc 0 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.303183] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.86:0/3054698889 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.86:0/3054698889' 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.314396] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:39:57.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.319355] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:39:57.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.319377] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:57.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.166397] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:39:57.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.166417] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.274369] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.177:0/474406666, rc 0 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.275328] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.177:0/474406666 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.177:0/474406666' 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.287251] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.291772] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.291792] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.395980] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.177:0/2890868015, rc 0 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.396030] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.177:0/2890868015 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.177:0/2890868015' 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.410434] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.415372] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:39:57.418 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.415392] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:57.422 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:39:57.652 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.411329] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.86:0/4141151177, rc 0 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.411629] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.86:0/4141151177 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.86:0/4141151177' 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.426627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.437625] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:39:57.653 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.437651] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.529657] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.86:0/4065499783, rc 0 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.529729] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.86:0/4065499783 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.86:0/4065499783' 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.543214] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.547742] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.547762] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.654 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.651330] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.86:0/1612834079, rc 0 2026-02-18T03:39:57.655 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.651395] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.86:0/1612834079 2026-02-18T03:39:57.655 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.86:0/1612834079' 2026-02-18T03:39:57.672 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.535413] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.177:0/1620493753, rc 0 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.535463] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.177:0/1620493753 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.177:0/1620493753' 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.549278] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.554139] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.554159] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.673 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.674 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.658174] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.177:0/628951371, rc 0 2026-02-18T03:39:57.674 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.658226] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.177:0/628951371 2026-02-18T03:39:57.674 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.177:0/628951371' 2026-02-18T03:39:57.674 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.671585] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.674 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:39:57.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.664206] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:39:57.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.668756] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:39:57.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.668777] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.760371] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.86:0/3808746016, rc 0 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.760430] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.86:0/3808746016 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.86:0/3808746016' 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.772119] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.776665] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.776685] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.884413] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.86:0/1240679355, rc 0 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.884476] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.86:0/1240679355 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.86:0/1240679355' 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.896047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.900892] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:39:57.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:57.900915] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:57.955 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:57.955 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1923065137' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {auth=49,config=2,health=13,kv=36} crc {auth=3567888917,config=1466402343,health=481669536,kv=3502139999}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=70,logm=30} crc {kv=1819019122,logm=2142009089}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1195873067}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2136449697}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101728420}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3415140949}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3513093501}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3299650563}) 2026-02-18T03:39:57.956 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=802716240}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2714056152}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3396880113}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1150252190}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1248043977}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1039785724}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=27930839}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3555517400}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=835336482}) 2026-02-18T03:39:57.957 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3537674233}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560439271}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=69321965}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2947623532}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3523148967}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840432567}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=26531296}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37114520}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3279142989}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=415614536}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3672473818}) 2026-02-18T03:39:57.958 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2285327648}) 2026-02-18T03:39:57.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.676166] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.676186] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.772405] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.177:0/2328563806, rc 0 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.772456] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.177:0/2328563806 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.177:0/2328563806' 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.784335] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.788902] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.788922] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:57.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.888836] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.177:0/4274380303, rc 0 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.888886] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.177:0/4274380303 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.177:0/4274380303' 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.901115] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.905643] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:39:57.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:57.905661] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:58.220 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2298097372}) 2026-02-18T03:39:58.220 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3214761275}) 2026-02-18T03:39:58.220 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2847136660}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405240699}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149900264}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553882025}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3576525008}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161831075}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3101621057}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3809020234}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=54,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=23} crc {logm=2066219331,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1391958374}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=605738338}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=52,mon_config_key=48} crc {mgrstat=3815306982,mon_config_key=1420410837}) 2026-02-18T03:39:58.221 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1572096967}) 2026-02-18T03:39:58.222 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=71,monmap=5,nvmeofgw=24} crc {mon_config_key=3750006584,monmap=1407976167,nvmeofgw=622001477}) 2026-02-18T03:39:58.222 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3058282537}) 2026-02-18T03:39:58.222 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=57,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {nvmeofgw=2521859407,osd_metadata=2727074769,osd_pg_creating=3014557745,osd_snap=3842414688,osdmap=2813383437}) 2026-02-18T03:39:58.222 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=83} crc {osdmap=1722849705}) 2026-02-18T03:39:58.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:57 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.000613] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.86:0/2032939290, rc 0 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.000679] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.86:0/2032939290 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.86:0/2032939290' 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.013191] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.018186] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.018206] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.109972] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.86:0/3099126110, rc 0 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.110033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.86:0/3099126110 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.86:0/3099126110' 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.122901] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.127484] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.127503] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.219038] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.86:0/3808448353, rc 0 2026-02-18T03:39:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1923065137' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {auth=49,config=2,health=13,kv=36} crc {auth=3567888917,config=1466402343,health=481669536,kv=3502139999}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {kv=70,logm=30} crc {kv=1819019122,logm=2142009089}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1195873067}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2136449697}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101728420}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3415140949}) 2026-02-18T03:39:58.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3513093501}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3299650563}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=802716240}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2714056152}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3396880113}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1150252190}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1248043977}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1039785724}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=27930839}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3555517400}) 2026-02-18T03:39:58.230 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=835336482}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3537674233}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560439271}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=69321965}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2947623532}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3523148967}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840432567}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=26531296}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37114520}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3279142989}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=415614536}) 2026-02-18T03:39:58.231 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3672473818}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2285327648}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2298097372}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3214761275}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2847136660}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405240699}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149900264}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553882025}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3576525008}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161831075}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3101621057}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3809020234}) 2026-02-18T03:39:58.232 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=54,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=23} crc {logm=2066219331,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1391958374}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=605738338}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=52,mon_config_key=48} crc {mgrstat=3815306982,mon_config_key=1420410837}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1572096967}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=71,monmap=5,nvmeofgw=24} crc {mon_config_key=3750006584,monmap=1407976167,nvmeofgw=622001477}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3058282537}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=57,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {nvmeofgw=2521859407,osd_metadata=2727074769,osd_pg_creating=3014557745,osd_snap=3842414688,osdmap=2813383437}) 2026-02-18T03:39:58.233 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:57 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=83} crc {osdmap=1722849705}) 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:57] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.013670] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.177:0/3113900246, rc 0 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.014327] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.177:0/3113900246 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.177:0/3113900246' 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.027938] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:39:58.258 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.032468] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.032487] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.140310] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.177:0/3581258394, rc 0 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.140359] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.177:0/3581258394 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.177:0/3581258394' 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.151700] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.156558] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.156577] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.259 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.256819] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.177:0/3109919887, rc 0 2026-02-18T03:39:58.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.256877] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.177:0/3109919887 2026-02-18T03:39:58.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.177:0/3109919887' 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/1923065137' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:39:58.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {auth=49,config=2,health=13,kv=36} crc {auth=3567888917,config=1466402343,health=481669536,kv=3502139999}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {kv=70,logm=30} crc {kv=1819019122,logm=2142009089}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1195873067}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2136449697}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101728420}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3415140949}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3513093501}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3299650563}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=802716240}) 2026-02-18T03:39:58.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2714056152}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3396880113}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1150252190}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1248043977}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1039785724}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=27930839}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3555517400}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=835336482}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3537674233}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560439271}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=69321965}) 2026-02-18T03:39:58.273 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2947623532}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3523148967}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840432567}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=26531296}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37114520}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3279142989}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=415614536}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3672473818}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2285327648}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2298097372}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3214761275}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2847136660}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=405240699}) 2026-02-18T03:39:58.274 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149900264}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553882025}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3576525008}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161831075}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3101621057}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3809020234}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {logm=54,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=23} crc {logm=2066219331,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1391958374}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=605738338}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=52,mon_config_key=48} crc {mgrstat=3815306982,mon_config_key=1420410837}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1572096967}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=71,monmap=5,nvmeofgw=24} crc {mon_config_key=3750006584,monmap=1407976167,nvmeofgw=622001477}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=3058282537}) 2026-02-18T03:39:58.275 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=57,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {nvmeofgw=2521859407,osd_metadata=2727074769,osd_pg_creating=3014557745,osd_snap=3842414688,osdmap=2813383437}) 2026-02-18T03:39:58.276 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:57 trial034 ceph-mon[21825]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=83} crc {osdmap=1722849705}) 2026-02-18T03:39:58.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.226618] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.86:0/3808448353 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.86:0/3808448353' 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.240110] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.244617] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.244638] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.340206] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.86:0/2441441423, rc 0 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.340267] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.86:0/2441441423 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.86:0/2441441423' 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.351968] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.356417] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.356439] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.448331] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.86:0/38120606, rc 0 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.448635] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.86:0/38120606 2026-02-18T03:39:58.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.86:0/38120606' 2026-02-18T03:39:58.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.466614] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:39:58.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.471389] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:39:58.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.471412] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.268003] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.272526] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.272547] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.376370] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.177:0/3828452884, rc 0 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.376418] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.177:0/3828452884 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.177:0/3828452884' 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.389998] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.394518] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.394538] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.494366] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.177:0/2370317269, rc 0 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.494415] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.177:0/2370317269 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.177:0/2370317269' 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.507469] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.510 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:39:58.763 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.558900] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.86:0/1402595738, rc 0 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.558964] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.86:0/1402595738 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.86:0/1402595738' 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.572581] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.577614] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.577639] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.669557] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.86:0/2899393973, rc 0 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.680627] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.86:0/2899393973 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.86:0/2899393973' 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.693460] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.697895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.697917] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.764 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.512013] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.512033] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.607958] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.177:0/324506700, rc 0 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.608015] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.177:0/324506700 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.177:0/324506700' 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.621450] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.626677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:39:58.830 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.626697] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.730698] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.177:0/3926185106, rc 0 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.739327] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.177:0/3926185106 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.177:0/3926185106' 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.751115] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.755862] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.755883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:58.831 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.026 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-mon[98535]: pgmap v511: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.97k op/s 2026-02-18T03:39:59.027 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.804414] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.86:0/3255094725, rc 0 2026-02-18T03:39:59.027 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.804489] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.86:0/3255094725 2026-02-18T03:39:59.027 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.86:0/3255094725' 2026-02-18T03:39:59.027 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.816627] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.027 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.821149] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.821171] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.912802] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.86:0/3851501693, rc 0 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.912877] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.86:0/3851501693 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.86:0/3851501693' 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.925137] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:39:59.028 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.929697] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:58.929717] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.025365] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.86:0/605127877, rc 0 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.025430] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.86:0/605127877 2026-02-18T03:39:59.029 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.86:0/605127877' 2026-02-18T03:39:59.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.868075] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.177:0/1989392553, rc 0 2026-02-18T03:39:59.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.868125] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.177:0/1989392553 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.177:0/1989392553' 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.880669] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.885168] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.885189] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.997028] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.177:0/3178778720, rc 0 2026-02-18T03:39:59.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:58.997078] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.177:0/3178778720 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:58 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:58] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.177:0/3178778720' 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.008895] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.013422] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.013444] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:39:58 trial155 ceph-mon[87919]: pgmap v511: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.97k op/s 2026-02-18T03:39:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:39:58 trial034 ceph-mon[21825]: pgmap v511: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.97k op/s 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.037933] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.042809] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.042829] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.138479] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.86:0/2124091268, rc 0 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.138549] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.86:0/2124091268 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.86:0/2124091268' 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.150900] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.155823] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.155846] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.255676] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.86:0/465347770, rc 0 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.255753] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.86:0/465347770 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.86:0/465347770' 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.266978] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.271407] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.271428] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.339 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.117403] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.177:0/4258073385, rc 0 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.117470] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.177:0/4258073385 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.177:0/4258073385' 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.129524] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.134086] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.134106] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.237840] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.177:0/2313671302, rc 0 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.237897] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.177:0/2313671302 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.177:0/2313671302' 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.252309] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.257505] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.257527] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.357401] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.177:0/3012529315, rc 0 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.357457] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.177:0/3012529315 2026-02-18T03:39:59.358 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.177:0/3012529315' 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.366999] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.86:0/4260597694, rc 0 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.367064] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.86:0/4260597694 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.86:0/4260597694' 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.378857] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.383487] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.383510] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.601 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.483151] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.86:0/784448194, rc 0 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.483219] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.86:0/784448194 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.86:0/784448194' 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.495233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.499802] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.499821] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.599383] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.86:0/3944630240, rc 0 2026-02-18T03:39:59.602 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.599444] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.86:0/3944630240 2026-02-18T03:39:59.612 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.368686] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.612 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:39:59.612 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.373454] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:39:59.612 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.373476] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.477738] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.177:0/3706734251, rc 0 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.478332] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.177:0/3706734251 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.177:0/3706734251' 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.491942] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.496477] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.496497] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.613 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.614 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.611430] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.177:0/3152494850, rc 0 2026-02-18T03:39:59.614 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.611487] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.177:0/3152494850 2026-02-18T03:39:59.614 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.177:0/3152494850' 2026-02-18T03:39:59.867 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.624428] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.629252] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.629271] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.736776] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.177:0/841086670, rc 0 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.736825] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.177:0/841086670 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.177:0/841086670' 2026-02-18T03:39:59.868 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.749724] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.754250] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.754271] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.866432] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.177:0/728456955, rc 0 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.866484] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.177:0/728456955 2026-02-18T03:39:59.869 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.177:0/728456955' 2026-02-18T03:39:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.86:0/3944630240' 2026-02-18T03:39:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.610864] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.615478] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.615500] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.711291] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.86:0/3429297954, rc 0 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.711358] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.86:0/3429297954 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.86:0/3429297954' 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.722567] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:39:59.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.727460] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.727482] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.830324] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.834774] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:39:59.875 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.834802] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.879313] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.884424] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.884443] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.126 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.988245] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.177:0/1613805214, rc 0 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:39:59.988299] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.177:0/1613805214 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:39:59 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:39:59] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.177:0/1613805214' 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.002861] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.007551] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.007569] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.111502] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.177:0/383585332, rc 0 2026-02-18T03:40:00.127 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.111551] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.177:0/383585332 2026-02-18T03:40:00.128 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.177:0/383585332' 2026-02-18T03:40:00.128 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.124573] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.128 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:40:00.161 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.161 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.944662] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:39:59] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.949082] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:39:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:39:59.949104] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.061633] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.066789] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.066816] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.162 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.163 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.163 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.160331] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.163 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:40:00.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.164762] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.164786] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.259658] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.264141] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.264162] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:00.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.358517] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.362977] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.362998] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.435 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.446 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.129153] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.129173] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.233151] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.177:0/3061179483, rc 0 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.233201] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.177:0/3061179483 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.177:0/3061179483' 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.246707] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.251388] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:40:00.447 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.251407] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.355568] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.177:0/1581612424, rc 0 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.355618] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.177:0/1581612424 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.177:0/1581612424' 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.366927] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.371469] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.371490] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.448 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.703 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.479628] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.177:0/2032944914, rc 0 2026-02-18T03:40:00.703 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.479678] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.177:0/2032944914 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.177:0/2032944914' 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.492405] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.497125] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.497147] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.613073] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.177:0/2477854695, rc 0 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.613125] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.177:0/2477854695 2026-02-18T03:40:00.704 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.177:0/2477854695' 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.625811] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.630589] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.630611] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.465769] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.470378] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.470400] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.564431] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.568848] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.568871] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.659872] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.664287] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.664307] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:40:00] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:00.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:00.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:00.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:37886 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.674443] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000167 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.690362] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000139 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.706420] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000177 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.722370] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000151 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.738392] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000160 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.754385] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000164 seconds 2026-02-18T03:40:00.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.778395] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000159 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.794392] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000162 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.810432] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000171 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.826393] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000160 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.842412] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000184 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.858397] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000169 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.874443] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000178 seconds 2026-02-18T03:40:00.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:40:00.890440] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000199 seconds 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.738577] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.743633] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.743652] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:00.970 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.897358] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.905145] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:00 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:00.905173] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:40:00] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:00.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:00.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: OPTIMIZED 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:53616 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.672507] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000232 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.688401] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000166 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.704437] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000179 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.720469] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000210 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.736464] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000193 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.760493] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000223 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.776518] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000214 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.792528] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000240 seconds 2026-02-18T03:40:00.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.808488] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000204 seconds 2026-02-18T03:40:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.824495] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000188 seconds 2026-02-18T03:40:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.852751] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000251 seconds 2026-02-18T03:40:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.868510] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000210 seconds 2026-02-18T03:40:00.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [2026-02-18 03:40:00.884504] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000190 seconds 2026-02-18T03:40:01.058 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-mon[98535]: pgmap v512: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 2.62k op/s 2026-02-18T03:40:01.059 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-mon[98535]: overall HEALTH_OK 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.771614] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.776156] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.776191] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.911071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:00] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:40:01.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.918974] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:40:01.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:00 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:00.919013] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:01.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.060 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-mon[87919]: pgmap v512: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 2.62k op/s 2026-02-18T03:40:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:00 trial155 ceph-mon[87919]: overall HEALTH_OK 2026-02-18T03:40:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-mon[21825]: pgmap v512: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 2.62k op/s 2026-02-18T03:40:01.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:00 trial034 ceph-mon[21825]: overall HEALTH_OK 2026-02-18T03:40:01.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.120653] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.129897] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.129936] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.277416] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.291893] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:40:01.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.291935] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.076566] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.080936] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:40:01.377 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.080955] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.250764] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.259465] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.259492] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.378 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.650 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.650 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.650 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.451542] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.457592] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.457629] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.635666] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.649272] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:40:01.651 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.649319] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:01.661 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.451207] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.455650] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.455670] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.662 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.661069] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 78.00 766.8k 727.2k 0.0k 7.5M 7.1M 0.0k nvme12n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 72.20 616.8k 628.4k 0.0k 6.0M 6.1M 0.0k nvme16n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 75.60 650.8k 727.6k 0.0k 6.4M 7.1M 0.0k nvme20n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 72.60 617.2k 662.4k 0.0k 6.0M 6.5M 0.0k nvme24n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 74.40 710.0k 651.6k 0.0k 6.9M 6.4M 0.0k nvme28n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 73.40 1.3M 1.2M 0.0k 12.5M 12.5M 0.0k nvme32n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 78.00 735.6k 736.0k 0.0k 7.2M 7.2M 0.0k nvme36n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 74.30 681.6k 661.2k 0.0k 6.7M 6.5M 0.0k nvme40n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 75.20 676.4k 708.4k 0.0k 6.6M 6.9M 0.0k nvme44n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 70.90 964.4k 1.1M 0.0k 9.4M 11.1M 0.0k nvme48n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 73.70 650.4k 665.2k 0.0k 6.4M 6.5M 0.0k nvme4n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 75.80 800.8k 664.8k 0.0k 7.8M 6.5M 0.0k nvme52n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 69.20 581.6k 666.4k 0.0k 5.7M 6.5M 0.0k nvme56n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 67.60 547.2k 680.8k 0.0k 5.3M 6.6M 0.0k nvme60n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 74.40 650.8k 644.0k 0.0k 6.4M 6.3M 0.0k nvme64n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 74.40 637.6k 688.4k 0.0k 6.2M 6.7M 0.0k nvme8n3 2026-02-18T03:40:01.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.670104] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.670132] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.829699] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.834128] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.834147] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.934 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.832011] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.840334] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:01.840396] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:01.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:01 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:01] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:01.999587] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:01] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.003977] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.003996] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.173985] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.178401] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:40:02.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.178420] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.021638] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.031196] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.031246] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.213649] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.515 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.222590] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.222629] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.404403] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.409028] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.409066] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.309581] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.313964] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.313983] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.467432] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:40:02.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.471995] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:40:02.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.472014] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:02.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.795 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-mon[98535]: pgmap v513: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.35k op/s 2026-02-18T03:40:02.795 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3649194601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:02.795 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4082592428' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.571168] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.579909] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.579953] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.795 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.796 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.794639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.660980] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.665358] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.665378] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.841028] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.845479] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:40:02.846 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:02.845499] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:02.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:02 trial155 ceph-mon[87919]: pgmap v513: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.35k op/s 2026-02-18T03:40:02.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3649194601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:02.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4082592428' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:03.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:02 trial034 ceph-mon[21825]: pgmap v513: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.35k op/s 2026-02-18T03:40:03.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3649194601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:03.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4082592428' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:03.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:40:03.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.808872] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:40:03.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.808919] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:02 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:02.999645] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.023913] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:40:03.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.023973] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:03.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:02 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:02] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.132 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.014638] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:40:03.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.019121] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:40:03.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.019141] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:03.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.133 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.172370] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.176829] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.176849] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.303499] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.307897] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.307917] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.430 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.223205] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.232601] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.232643] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.433 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.432835] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.505040] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.525156] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.525180] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.437564] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.437613] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.610535] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:40:03.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.615255] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:40:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.615283] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.735398] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.739780] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.739798] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.914256] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.918743] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:40:03.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:03 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:03.918762] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.805732] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.810400] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:03.810424] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:03 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:03] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.004648] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:40:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.012467] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:40:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.012502] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.263 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.137478] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.141996] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.142035] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.264 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.261981] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.359 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.091077] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.095466] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.095485] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.247098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.360 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:40:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.251464] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:40:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.251484] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.361 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.266482] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.266512] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.396379] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.400895] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:40:04.551 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.400927] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.552 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.552 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.552 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.550630] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.432363] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.437774] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.437793] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.654 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.653413] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.865 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-mon[98535]: pgmap v514: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.76k op/s 2026-02-18T03:40:04.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:40:04.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.562568] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:40:04.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.562618] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:04.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.865 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.729696] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:40:04.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.735398] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:40:04.866 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.735427] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.657893] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.657914] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.873330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.881454] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:40:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:04.881477] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:04.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:04 trial155 ceph-mon[87919]: pgmap v514: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.76k op/s 2026-02-18T03:40:05.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:04 trial034 ceph-mon[21825]: pgmap v514: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 18 MiB/s wr, 2.76k op/s 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:04.870199] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.86 port 4420 *** 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:04] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial034 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial177 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial086 differs from requested host trial155 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:40:05.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:05] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.b). 2026-02-18T03:40:05.351 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.351 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:04] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.351 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.043865] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.351 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.048243] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.048261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.230494] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.236554] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.236582] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.352 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.406126] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.410785] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.410807] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.705 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.591896] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.706 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:40:05.706 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.597236] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:40:05.706 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.597255] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:40:05.706 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.706 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.753645] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.758079] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.758098] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.933430] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:05] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.942449] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:40:05.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:05 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:05.942477] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:40:05.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:05 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/571047141' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:06.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:05 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/571047141' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:06.054 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/571047141' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:06.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:06.053773] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.103516] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.108017] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:40:06.428 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.108036] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.301161] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.305625] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.305643] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.429 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:06.429397] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.177 port 4420 *** 2026-02-18T03:40:06.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.685 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.686 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.687 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.688 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.689 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.690 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.690 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.690 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.691 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.692 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.693 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.694 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.694 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:40:06.694 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:40:06.694 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:40:06.694 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:06 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:06] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:40:06.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:06 trial155 ceph-mon[87919]: pgmap v515: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 14 MiB/s wr, 2.74k op/s 2026-02-18T03:40:07.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:06 trial034 ceph-mon[21825]: pgmap v515: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 14 MiB/s wr, 2.74k op/s 2026-02-18T03:40:07.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:06 trial086 ceph-mon[98535]: pgmap v515: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 14 MiB/s wr, 2.74k op/s 2026-02-18T03:40:07.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:40:07] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:07.951 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:07.952 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:07.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:40:07.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:36434 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:40:07] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:40:07.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:38580 2026-02-18T03:40:08.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:07 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/537608419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:08.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:07 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/537608419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:07 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/537608419' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:09.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:08 trial155 ceph-mon[87919]: pgmap v516: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 16 MiB/s wr, 3.10k op/s 2026-02-18T03:40:09.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:08 trial034 ceph-mon[21825]: pgmap v516: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 16 MiB/s wr, 3.10k op/s 2026-02-18T03:40:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:08 trial086 ceph-mon[98535]: pgmap v516: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 18 MiB/s rd, 16 MiB/s wr, 3.10k op/s 2026-02-18T03:40:10.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3092225147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1846223879' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3092225147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1846223879' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3092225147' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1846223879' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:40:09] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:10.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:10.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 2 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:40:10.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:58734 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:09.959980] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000145 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:09.983938] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000152 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:09.999940] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000150 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.015994] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000196 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.031957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000171 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.047952] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000164 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.063923] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000134 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.079935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000145 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.103929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000136 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.119941] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000146 seconds 2026-02-18T03:40:10.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.135957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000165 seconds 2026-02-18T03:40:10.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.151975] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000175 seconds 2026-02-18T03:40:10.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.167927] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000131 seconds 2026-02-18T03:40:10.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.183926] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000133 seconds 2026-02-18T03:40:10.958 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:10.664537] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:40:10] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:40:11.216 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:40:11.217 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:40:11.218 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.219 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.220 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: states { 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: grp_id: 4 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: state: OPTIMIZED 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: } 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: ], , client address: IPv4 10.20.193.177:39720 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:10.959389] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000935 seconds 2026-02-18T03:40:11.221 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:10.974564] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000191 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:10.990583] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000225 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.006551] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000191 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.022547] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000189 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.038577] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000221 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.054572] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000213 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.070584] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000213 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.102636] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000273 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.134654] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000287 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.150649] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000279 seconds 2026-02-18T03:40:11.222 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.166617] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000250 seconds 2026-02-18T03:40:11.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:10 trial155 ceph-mon[87919]: pgmap v517: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 18 MiB/s wr, 3.18k op/s 2026-02-18T03:40:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:10 trial034 ceph-mon[21825]: pgmap v517: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 18 MiB/s wr, 3.18k op/s 2026-02-18T03:40:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:10 trial086 ceph-mon[98535]: pgmap v517: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 18 MiB/s wr, 3.18k op/s 2026-02-18T03:40:11.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 131.00 1.2M 1.1M 0.0k 12.2M 11.3M 0.0k nvme12n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 136.50 1.7M 1.6M 0.0k 17.3M 16.2M 0.0k nvme16n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 131.90 1.7M 1.7M 0.0k 17.0M 16.6M 0.0k nvme20n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 130.00 1.2M 1.1M 0.0k 12.4M 11.3M 0.0k nvme24n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 126.20 1.1M 1.1M 0.0k 11.1M 11.3M 0.0k nvme28n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 127.90 1.9M 2.1M 0.0k 19.3M 20.8M 0.0k nvme32n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 129.50 1.5M 1.4M 0.0k 15.4M 14.0M 0.0k nvme36n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 125.70 1.9M 1.8M 0.0k 19.1M 18.3M 0.0k nvme40n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 128.10 1.2M 1.1M 0.0k 11.6M 11.1M 0.0k nvme44n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 126.80 1.9M 2.0M 0.0k 19.4M 20.0M 0.0k nvme48n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 136.00 1.2M 1.2M 0.0k 11.8M 12.1M 0.0k nvme4n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 128.90 1.3M 1.1M 0.0k 12.6M 11.2M 0.0k nvme52n3 2026-02-18T03:40:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 130.20 1.2M 1.1M 0.0k 12.4M 11.0M 0.0k nvme56n3 2026-02-18T03:40:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 134.60 1.1M 1.2M 0.0k 11.5M 12.1M 0.0k nvme60n3 2026-02-18T03:40:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 133.40 1.3M 1.2M 0.0k 12.7M 11.6M 0.0k nvme64n3 2026-02-18T03:40:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 130.00 1.2M 1.4M 0.0k 12.3M 13.8M 0.0k nvme8n3 2026-02-18T03:40:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:12 trial155 ceph-mon[87919]: pgmap v518: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 3.05k op/s 2026-02-18T03:40:13.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:12 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/277848095' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:13.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:12 trial034 ceph-mon[21825]: pgmap v518: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 3.05k op/s 2026-02-18T03:40:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:12 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/277848095' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:12 trial086 ceph-mon[98535]: pgmap v518: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 3.05k op/s 2026-02-18T03:40:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/277848095' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:15.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:14 trial155 ceph-mon[87919]: pgmap v519: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 23 MiB/s rd, 22 MiB/s wr, 3.11k op/s 2026-02-18T03:40:15.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:14 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4127340008' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:14 trial034 ceph-mon[21825]: pgmap v519: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 23 MiB/s rd, 22 MiB/s wr, 3.11k op/s 2026-02-18T03:40:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:14 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4127340008' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:14 trial086 ceph-mon[98535]: pgmap v519: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 23 MiB/s rd, 22 MiB/s wr, 3.11k op/s 2026-02-18T03:40:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:14 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4127340008' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:16 trial155 ceph-mon[87919]: pgmap v520: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 2.92k op/s 2026-02-18T03:40:17.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3100406035' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3849614471' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:16 trial034 ceph-mon[21825]: pgmap v520: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 2.92k op/s 2026-02-18T03:40:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3100406035' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3849614471' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:16 trial086 ceph-mon[98535]: pgmap v520: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 2.92k op/s 2026-02-18T03:40:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3100406035' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3849614471' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:19.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:18 trial155 ceph-mon[87919]: pgmap v521: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.73k op/s 2026-02-18T03:40:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:18 trial034 ceph-mon[21825]: pgmap v521: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.73k op/s 2026-02-18T03:40:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:18 trial086 ceph-mon[98535]: pgmap v521: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.73k op/s 2026-02-18T03:40:20.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:19 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3733575007' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:20.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:19 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3733575007' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:20.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3733575007' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:21.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:20 trial155 ceph-mon[87919]: pgmap v522: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.42k op/s 2026-02-18T03:40:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:20 trial034 ceph-mon[21825]: pgmap v522: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.42k op/s 2026-02-18T03:40:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:20 trial086 ceph-mon[98535]: pgmap v522: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.42k op/s 2026-02-18T03:40:21.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.40 3.1M 3.1M 0.0k 31.4M 31.1M 0.0k nvme12n3 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.70 3.2M 3.2M 0.0k 31.9M 32.4M 0.0k nvme16n3 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 3.2M 3.3M 0.0k 32.3M 32.5M 0.0k nvme20n3 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.50 2.7M 2.8M 0.0k 26.7M 28.3M 0.0k nvme24n3 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.90 3.2M 3.0M 0.0k 31.6M 29.6M 0.0k nvme28n3 2026-02-18T03:40:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 211.90 3.4M 3.1M 0.0k 33.6M 31.5M 0.0k nvme32n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 3.2M 3.2M 0.0k 32.1M 31.7M 0.0k nvme36n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.40 3.2M 3.2M 0.0k 31.5M 32.4M 0.0k nvme40n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 3.3M 3.1M 0.0k 32.9M 31.4M 0.0k nvme44n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 3.0M 3.2M 0.0k 30.1M 32.0M 0.0k nvme48n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 3.3M 3.2M 0.0k 32.8M 32.2M 0.0k nvme4n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.5M 2.7M 0.0k 24.7M 27.0M 0.0k nvme52n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 2.6M 2.5M 0.0k 26.0M 24.9M 0.0k nvme56n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 212.30 3.1M 3.1M 0.0k 30.8M 30.7M 0.0k nvme60n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.40 2.4M 2.6M 0.0k 23.7M 25.9M 0.0k nvme64n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 3.4M 3.2M 0.0k 33.5M 31.6M 0.0k nvme8n3 2026-02-18T03:40:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:21 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/2831112758' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:22.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:21 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2831112758' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2831112758' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:23.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:22 trial155 ceph-mon[87919]: pgmap v523: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.30k op/s 2026-02-18T03:40:23.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:22 trial034 ceph-mon[21825]: pgmap v523: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.30k op/s 2026-02-18T03:40:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:22 trial086 ceph-mon[98535]: pgmap v523: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.30k op/s 2026-02-18T03:40:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2528847767' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:24.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:23 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3477832003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2528847767' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3477832003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:23 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2528847767' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:23 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3477832003' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:25.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:24 trial034 ceph-mon[21825]: pgmap v524: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.89k op/s 2026-02-18T03:40:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:24 trial086 ceph-mon[98535]: pgmap v524: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.89k op/s 2026-02-18T03:40:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:24 trial155 ceph-mon[87919]: pgmap v524: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.89k op/s 2026-02-18T03:40:27.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:26 trial034 ceph-mon[21825]: pgmap v525: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.18k op/s 2026-02-18T03:40:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:26 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/470434600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:26 trial086 ceph-mon[98535]: pgmap v525: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.18k op/s 2026-02-18T03:40:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/470434600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:26 trial155 ceph-mon[87919]: pgmap v525: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.18k op/s 2026-02-18T03:40:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:26 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/470434600' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:28 trial034 ceph-mon[21825]: pgmap v526: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.45k op/s 2026-02-18T03:40:29.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:28 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3648542155' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:28 trial086 ceph-mon[98535]: pgmap v526: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.45k op/s 2026-02-18T03:40:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:28 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3648542155' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:28 trial155 ceph-mon[87919]: pgmap v526: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.45k op/s 2026-02-18T03:40:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:28 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3648542155' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:30 trial034 ceph-mon[21825]: pgmap v527: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.19k op/s 2026-02-18T03:40:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2150441081' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:30 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/2478457321' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:30 trial086 ceph-mon[98535]: pgmap v527: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.19k op/s 2026-02-18T03:40:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2150441081' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2478457321' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:30 trial155 ceph-mon[87919]: pgmap v527: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.19k op/s 2026-02-18T03:40:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:30 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2150441081' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:30 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2478457321' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:31.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 3.2M 3.1M 0.0k 32.1M 31.5M 0.0k nvme12n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 193.10 2.9M 3.1M 0.0k 28.9M 30.9M 0.0k nvme16n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 3.3M 3.1M 0.0k 32.6M 31.3M 0.0k nvme20n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 3.3M 3.1M 0.0k 33.4M 31.3M 0.0k nvme24n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 3.2M 3.2M 0.0k 32.2M 32.1M 0.0k nvme28n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.50 3.1M 3.1M 0.0k 31.0M 30.9M 0.0k nvme32n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 3.1M 3.2M 0.0k 31.1M 31.8M 0.0k nvme36n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 3.0M 3.1M 0.0k 29.7M 31.2M 0.0k nvme40n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 3.4M 3.2M 0.0k 33.5M 31.6M 0.0k nvme44n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.30 3.2M 3.0M 0.0k 31.6M 30.2M 0.0k nvme48n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 193.20 2.9M 3.1M 0.0k 29.0M 30.9M 0.0k nvme4n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 3.0M 3.2M 0.0k 30.4M 31.5M 0.0k nvme52n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 3.2M 3.2M 0.0k 31.6M 31.8M 0.0k nvme56n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 3.0M 3.2M 0.0k 29.8M 32.3M 0.0k nvme60n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.70 3.1M 3.2M 0.0k 31.4M 31.6M 0.0k nvme64n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 3.0M 3.2M 0.0k 29.9M 31.8M 0.0k nvme8n3 2026-02-18T03:40:31.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:32 trial034 ceph-mon[21825]: pgmap v528: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 2.98k op/s 2026-02-18T03:40:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:32 trial086 ceph-mon[98535]: pgmap v528: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 2.98k op/s 2026-02-18T03:40:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:32 trial155 ceph-mon[87919]: pgmap v528: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 2.98k op/s 2026-02-18T03:40:34.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:33 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3058614641' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3058614641' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:34.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:33 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3058614641' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:35.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:34 trial034 ceph-mon[21825]: pgmap v529: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.41k op/s 2026-02-18T03:40:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:34 trial086 ceph-mon[98535]: pgmap v529: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.41k op/s 2026-02-18T03:40:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:34 trial155 ceph-mon[87919]: pgmap v529: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.41k op/s 2026-02-18T03:40:36.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:35 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1431728534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:35 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1431728534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:35 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1431728534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:36 trial034 ceph-mon[21825]: pgmap v530: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.27k op/s 2026-02-18T03:40:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:36 trial086 ceph-mon[98535]: pgmap v530: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.27k op/s 2026-02-18T03:40:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:36 trial155 ceph-mon[87919]: pgmap v530: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.27k op/s 2026-02-18T03:40:38.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2421405625' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:38.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:38 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3327769771' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2421405625' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3327769771' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2421405625' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3327769771' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:39.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:39 trial034 ceph-mon[21825]: pgmap v531: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:40:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:39 trial086 ceph-mon[98535]: pgmap v531: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:40:39.378 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:39 trial155 ceph-mon[87919]: pgmap v531: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.44k op/s 2026-02-18T03:40:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:41 trial034 ceph-mon[21825]: pgmap v532: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.99k op/s 2026-02-18T03:40:41.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:41 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/1451684171' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:41 trial086 ceph-mon[98535]: pgmap v532: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.99k op/s 2026-02-18T03:40:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1451684171' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:41 trial155 ceph-mon[87919]: pgmap v532: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.99k op/s 2026-02-18T03:40:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1451684171' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:41.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:41.735 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 208.80 3.3M 3.2M 0.0k 32.5M 31.7M 0.0k nvme12n3 2026-02-18T03:40:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 3.1M 3.0M 0.0k 31.4M 30.3M 0.0k nvme16n3 2026-02-18T03:40:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 3.0M 3.0M 0.0k 30.0M 30.2M 0.0k nvme20n3 2026-02-18T03:40:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 3.1M 3.1M 0.0k 30.9M 30.9M 0.0k nvme24n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 3.2M 3.1M 0.0k 31.8M 31.0M 0.0k nvme28n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.9M 3.0M 0.0k 28.5M 29.8M 0.0k nvme32n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 3.1M 2.9M 0.0k 30.9M 29.3M 0.0k nvme36n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 3.0M 3.1M 0.0k 30.1M 30.6M 0.0k nvme40n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 3.1M 3.0M 0.0k 31.2M 30.4M 0.0k nvme44n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 3.2M 2.9M 0.0k 31.8M 29.3M 0.0k nvme48n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.9M 3.1M 0.0k 29.4M 31.0M 0.0k nvme4n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 3.2M 3.0M 0.0k 31.7M 30.1M 0.0k nvme52n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 3.0M 3.1M 0.0k 29.8M 31.0M 0.0k nvme56n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 3.2M 3.1M 0.0k 31.6M 31.4M 0.0k nvme60n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 3.1M 3.1M 0.0k 30.5M 30.7M 0.0k nvme64n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.8M 3.1M 0.0k 28.2M 31.0M 0.0k nvme8n3 2026-02-18T03:40:41.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:43 trial034 ceph-mon[21825]: pgmap v533: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 2.95k op/s 2026-02-18T03:40:43.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:43 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/879246948' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:43 trial086 ceph-mon[98535]: pgmap v533: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 2.95k op/s 2026-02-18T03:40:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:43 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/879246948' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:43 trial155 ceph-mon[87919]: pgmap v533: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 2.95k op/s 2026-02-18T03:40:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:43 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/879246948' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:45 trial034 ceph-mon[21825]: pgmap v534: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.42k op/s 2026-02-18T03:40:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2909480557' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:45 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/4056080265' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:45 trial086 ceph-mon[98535]: pgmap v534: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.42k op/s 2026-02-18T03:40:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2909480557' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4056080265' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:45 trial155 ceph-mon[87919]: pgmap v534: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 52 MiB/s wr, 3.42k op/s 2026-02-18T03:40:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2909480557' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4056080265' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:47 trial034 ceph-mon[21825]: pgmap v535: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.28k op/s 2026-02-18T03:40:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:47 trial086 ceph-mon[98535]: pgmap v535: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.28k op/s 2026-02-18T03:40:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:47 trial155 ceph-mon[87919]: pgmap v535: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.28k op/s 2026-02-18T03:40:48.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:48 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3970174820' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3970174820' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3970174820' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:49.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:49 trial034 ceph-mon[21825]: pgmap v536: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.43k op/s 2026-02-18T03:40:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:49 trial086 ceph-mon[98535]: pgmap v536: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.43k op/s 2026-02-18T03:40:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:49 trial155 ceph-mon[87919]: pgmap v536: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.43k op/s 2026-02-18T03:40:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:50 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4032154801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:50 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4032154801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:50.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:50 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/4032154801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:51 trial086 ceph-mon[98535]: pgmap v537: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 2.97k op/s 2026-02-18T03:40:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:51 trial155 ceph-mon[87919]: pgmap v537: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 2.97k op/s 2026-02-18T03:40:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:51 trial034 ceph-mon[21825]: pgmap v537: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 2.97k op/s 2026-02-18T03:40:51.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 191.80 2.8M 3.0M 0.0k 27.5M 29.9M 0.0k nvme12n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 210.60 3.2M 2.9M 0.0k 31.6M 29.3M 0.0k nvme16n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.9M 3.0M 0.0k 28.8M 29.9M 0.0k nvme20n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.90 3.2M 3.0M 0.0k 32.4M 29.6M 0.0k nvme24n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.70 2.9M 3.0M 0.0k 28.7M 29.6M 0.0k nvme28n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 210.70 3.0M 2.8M 0.0k 30.1M 28.1M 0.0k nvme32n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.9M 2.9M 0.0k 29.2M 28.5M 0.0k nvme36n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.7M 2.8M 0.0k 27.2M 27.9M 0.0k nvme40n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.8M 3.0M 0.0k 28.4M 29.7M 0.0k nvme44n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 2.8M 2.8M 0.0k 27.7M 28.4M 0.0k nvme48n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.9M 2.9M 0.0k 28.9M 28.7M 0.0k nvme4n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 3.0M 2.9M 0.0k 30.1M 28.9M 0.0k nvme52n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.70 3.0M 3.0M 0.0k 29.8M 29.6M 0.0k nvme56n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.7M 2.9M 0.0k 27.2M 29.0M 0.0k nvme60n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.9M 3.0M 0.0k 29.2M 29.6M 0.0k nvme64n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 3.1M 2.7M 0.0k 30.9M 27.2M 0.0k nvme8n3 2026-02-18T03:40:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:40:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3802353578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1823100919' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:52 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3802353578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:52 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1823100919' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:52.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/3802353578' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:52 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/1823100919' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:53 trial086 ceph-mon[98535]: pgmap v538: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 2.97k op/s 2026-02-18T03:40:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:53 trial155 ceph-mon[87919]: pgmap v538: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 2.97k op/s 2026-02-18T03:40:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:53 trial034 ceph-mon[21825]: pgmap v538: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 2.97k op/s 2026-02-18T03:40:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:40:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:40:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:40:54.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:40:54.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:54 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:40:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:40:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:40:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:40:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:40:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:54 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:40:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:40:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:40:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:40:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:40:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:54 trial034 ceph-mon[21825]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:40:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:55 trial086 ceph-mon[98535]: pgmap v539: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.45k op/s 2026-02-18T03:40:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3243978069' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:55 trial155 ceph-mon[87919]: pgmap v539: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.45k op/s 2026-02-18T03:40:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3243978069' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:55 trial034 ceph-mon[21825]: pgmap v539: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.45k op/s 2026-02-18T03:40:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:55 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/3243978069' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:57 trial086 ceph-mon[98535]: pgmap v540: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:40:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:57 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1810648166' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:57.423 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:40:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:57 trial155 ceph-mon[87919]: pgmap v540: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:40:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:57 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1810648166' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:57 trial034 ceph-mon[21825]: pgmap v540: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:40:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:57 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1810648166' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:59 trial086 ceph-mon[98535]: pgmap v541: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.42k op/s 2026-02-18T03:40:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/614599569' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:40:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3230843269' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:59 trial155 ceph-mon[87919]: pgmap v541: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.42k op/s 2026-02-18T03:40:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/614599569' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:40:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3230843269' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:59 trial034 ceph-mon[21825]: pgmap v541: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.42k op/s 2026-02-18T03:40:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/614599569' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:40:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:40:59 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/3230843269' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:01 trial086 ceph-mon[98535]: pgmap v542: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 2.95k op/s 2026-02-18T03:41:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:01 trial155 ceph-mon[87919]: pgmap v542: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 2.95k op/s 2026-02-18T03:41:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:01 trial034 ceph-mon[21825]: pgmap v542: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 2.95k op/s 2026-02-18T03:41:01.734 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.9M 2.9M 0.0k 28.9M 28.6M 0.0k nvme12n3 2026-02-18T03:41:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 2.8M 3.0M 0.0k 27.5M 29.6M 0.0k nvme16n3 2026-02-18T03:41:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.7M 2.6M 0.0k 26.7M 26.5M 0.0k nvme20n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.9M 2.8M 0.0k 29.1M 27.9M 0.0k nvme24n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.20 2.9M 2.9M 0.0k 28.6M 28.7M 0.0k nvme28n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.60 2.8M 2.9M 0.0k 27.7M 28.5M 0.0k nvme32n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.9M 2.8M 0.0k 29.1M 27.7M 0.0k nvme36n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.5M 2.8M 0.0k 25.3M 27.9M 0.0k nvme40n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.9M 2.8M 0.0k 28.8M 28.4M 0.0k nvme44n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.8M 2.7M 0.0k 27.7M 27.3M 0.0k nvme48n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 2.7M 2.9M 0.0k 27.4M 29.3M 0.0k nvme4n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.9M 2.8M 0.0k 29.2M 28.3M 0.0k nvme52n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 2.6M 2.9M 0.0k 26.1M 28.9M 0.0k nvme56n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.8M 2.9M 0.0k 27.6M 28.6M 0.0k nvme60n3 2026-02-18T03:41:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.8M 2.9M 0.0k 28.4M 29.4M 0.0k nvme64n3 2026-02-18T03:41:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 2.7M 2.8M 0.0k 27.1M 27.6M 0.0k nvme8n3 2026-02-18T03:41:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4126809507' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/4126809507' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:02 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/4126809507' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:03 trial086 ceph-mon[98535]: pgmap v543: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.94k op/s 2026-02-18T03:41:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:03 trial155 ceph-mon[87919]: pgmap v543: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.94k op/s 2026-02-18T03:41:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:03 trial034 ceph-mon[21825]: pgmap v543: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.94k op/s 2026-02-18T03:41:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:04 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1537363567' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:04 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1537363567' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:04 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1537363567' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:05 trial086 ceph-mon[98535]: pgmap v544: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.56k op/s 2026-02-18T03:41:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:05 trial155 ceph-mon[87919]: pgmap v544: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.56k op/s 2026-02-18T03:41:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:05 trial034 ceph-mon[21825]: pgmap v544: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.56k op/s 2026-02-18T03:41:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2175660182' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/309743734' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2175660182' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/309743734' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/2175660182' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:06.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:06 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/309743734' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:07 trial086 ceph-mon[98535]: pgmap v545: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.26k op/s 2026-02-18T03:41:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:07 trial155 ceph-mon[87919]: pgmap v545: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.26k op/s 2026-02-18T03:41:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:07 trial034 ceph-mon[21825]: pgmap v545: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.26k op/s 2026-02-18T03:41:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:09 trial086 ceph-mon[98535]: pgmap v546: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.42k op/s 2026-02-18T03:41:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/68878784' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:09 trial155 ceph-mon[87919]: pgmap v546: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.42k op/s 2026-02-18T03:41:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/68878784' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:09 trial034 ceph-mon[21825]: pgmap v546: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.42k op/s 2026-02-18T03:41:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:09 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/68878784' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:11 trial034 ceph-mon[21825]: pgmap v547: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:41:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:11 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/3084608615' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:11 trial086 ceph-mon[98535]: pgmap v547: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:41:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:11 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3084608615' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:11 trial155 ceph-mon[87919]: pgmap v547: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:41:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:11 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3084608615' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.90 2.8M 2.6M 0.0k 27.9M 26.1M 0.0k nvme12n3 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.8M 2.8M 0.0k 27.7M 27.5M 0.0k nvme16n3 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.7M 2.7M 0.0k 27.2M 27.5M 0.0k nvme20n3 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.7M 2.8M 0.0k 27.3M 28.3M 0.0k nvme24n3 2026-02-18T03:41:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.9M 2.7M 0.0k 28.9M 27.2M 0.0k nvme28n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 2.6M 2.7M 0.0k 25.9M 26.9M 0.0k nvme32n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.90 2.9M 2.7M 0.0k 29.2M 27.2M 0.0k nvme36n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.6M 2.6M 0.0k 25.6M 26.5M 0.0k nvme40n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.6M 2.6M 0.0k 26.5M 26.0M 0.0k nvme44n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 2.8M 2.7M 0.0k 28.2M 27.3M 0.0k nvme48n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 3.0M 2.8M 0.0k 30.5M 27.6M 0.0k nvme4n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.7M 2.7M 0.0k 27.3M 27.2M 0.0k nvme52n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 2.9M 2.8M 0.0k 29.0M 28.0M 0.0k nvme56n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.9M 2.9M 0.0k 28.7M 28.8M 0.0k nvme60n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.7M 2.8M 0.0k 27.1M 28.1M 0.0k nvme64n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 210.90 3.1M 2.8M 0.0k 31.0M 27.7M 0.0k nvme8n3 2026-02-18T03:41:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:13 trial086 ceph-mon[98535]: pgmap v548: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.02k op/s 2026-02-18T03:41:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4268324325' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/665691797' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:13 trial155 ceph-mon[87919]: pgmap v548: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.02k op/s 2026-02-18T03:41:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/4268324325' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/665691797' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:13 trial034 ceph-mon[21825]: pgmap v548: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.02k op/s 2026-02-18T03:41:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.34:0/4268324325' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:13 trial034 ceph-mon[21825]: from='client.? 10.20.193.155:0/665691797' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:14.095 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:41:14.096 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:41:14.096 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:41:14.126 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:14.126 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:41:14.126 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 5min ago 2026-02-18T03:41:14.126 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 339.7M (peak: 345.3M) 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 21min 17.618s 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.127 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:41:14.128 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:14.129 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:41:14.129 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:41:14.129 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 2 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:14.130 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:40:07 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:36434 2026-02-18T03:41:14.130 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 1min 21s ago 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.162 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 325.2M (peak: 327.8M) 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 5min 16.818s 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.163 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:41:14.164 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:41:14.164 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.031957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000171 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.047952] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000164 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.063923] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000134 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.079935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000145 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.103929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000136 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.119941] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000146 seconds 2026-02-18T03:41:14.165 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.135957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000165 seconds 2026-02-18T03:41:14.166 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.151975] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000175 seconds 2026-02-18T03:41:14.166 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.167927] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000131 seconds 2026-02-18T03:41:14.166 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.183926] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000133 seconds 2026-02-18T03:41:14.166 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:41:14.199 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:14.199 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:41:14.199 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 7min ago 2026-02-18T03:41:14.199 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.199 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 370.1M (peak: 372.5M) 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 28min 18.114s 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:41:14.200 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:41:14.201 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:41:14.202 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:41:14.202 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:38580 2026-02-18T03:41:14.203 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:41:14.246 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 1min 21s ago 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63758 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63759 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 63839 (conmon) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 346.9M (peak: 348.7M) 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 5min 24.242s 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:41:14.247 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─63841 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─63843 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─63966 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─64103 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: │ └─64108 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: └─63839 /usr/bin/conmon --api-version 1 -c 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 -u 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5/userdata -p /run/containers/storage/overlay-containers/5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:10 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:10.990583] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000225 seconds 2026-02-18T03:41:14.248 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.006551] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000191 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.022547] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000189 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.038577] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000221 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.054572] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000213 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.070584] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000213 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.102636] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000273 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.134654] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000287 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.150649] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000279 seconds 2026-02-18T03:41:14.249 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:40:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [2026-02-18 03:40:11.166617] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000250 seconds 2026-02-18T03:41:14.250 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:41:14.478 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:41:14.478 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 3m ago 16m trial034=x;count:1 2026-02-18T03:41:14.478 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 7m ago 16m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:41:14.478 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 7m ago 14m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:41:14.478 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 7m ago 15m trial155 2026-02-18T03:41:14.487 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:41:14.675 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:41:14.675 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (5m) 3m ago 5m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:41:14.675 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (82s) 81s ago 5m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:41:14.675 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (7m) 7m ago 11m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:41:14.675 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (81s) 81s ago 5m 54.9M - 1.6.5 99a57256b38c 5546f1f79e4f 2026-02-18T03:41:14.683 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:41:14.908 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:41:14.917 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 82s) [leader: a] 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 16m) 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 15m), 8 in (since 15m) 2026-02-18T03:41:15.135 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: usage: 52 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: client: 50 MiB/s rd, 50 MiB/s wr, 1.84k op/s rd, 1.82k op/s wr 2026-02-18T03:41:15.136 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:41:15.144 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:41:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:15 trial086 ceph-mon[98535]: pgmap v549: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.66k op/s 2026-02-18T03:41:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/21885155' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 188, 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 2, 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:41:15.376 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 109, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:41:15.377 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:41:15.385 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.443 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.444 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:41:15.445 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:41:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:15 trial155 ceph-mon[87919]: pgmap v549: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.66k op/s 2026-02-18T03:41:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:15 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/21885155' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:41:15.490 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.490 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:41:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:15 trial034 ceph-mon[21825]: pgmap v549: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.66k op/s 2026-02-18T03:41:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:15 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/21885155' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:41:15.535 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.535 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:41:15.580 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.580 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:41:15.625 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.625 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:41:15.671 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.671 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:41:15.715 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.716 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:41:15.760 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.760 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:41:15.803 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.804 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:41:15.847 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.848 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:41:15.892 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.892 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:41:15.936 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.937 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:41:15.982 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:15.983 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:41:16.027 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.027 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:41:16.071 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.071 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:41:16.117 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.117 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:41:16.162 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.163 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:41:16.207 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.208 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:41:16.254 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.255 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:41:16.299 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.300 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:41:16.344 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.345 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:41:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:16 trial086 ceph-mon[98535]: from='client.90661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:16 trial086 ceph-mon[98535]: from='client.90667 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2052182166' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:41:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1736784265' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:41:16.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/399760895' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:16.389 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.390 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:41:16.475 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.475 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:41:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:16 trial155 ceph-mon[87919]: from='client.90661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:16 trial155 ceph-mon[87919]: from='client.90667 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/2052182166' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:41:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1736784265' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:41:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/399760895' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:16.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:16 trial034 ceph-mon[21825]: from='client.90661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:16 trial034 ceph-mon[21825]: from='client.90667 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:41:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/2052182166' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:41:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1736784265' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:41:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:16 trial034 ceph-mon[21825]: from='client.? 10.20.193.86:0/399760895' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:16.561 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.562 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:41:16.606 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.607 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:41:16.652 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.653 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:41:16.698 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.699 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:41:16.743 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.744 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:41:16.788 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.790 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:41:16.835 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.835 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:41:16.880 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.881 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:41:16.925 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.927 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:41:16.972 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:16.973 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:41:17.018 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.019 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:41:17.064 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.065 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:41:17.110 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.111 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:41:17.155 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.156 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:41:17.201 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.202 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:41:17.248 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.249 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:41:17.294 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.295 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:41:17.341 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.342 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:41:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:17 trial086 ceph-mon[98535]: pgmap v550: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 42 MiB/s wr, 3.15k op/s 2026-02-18T03:41:17.387 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.388 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:41:17.434 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.434 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:41:17.478 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:17 trial155 ceph-mon[87919]: pgmap v550: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 42 MiB/s wr, 3.15k op/s 2026-02-18T03:41:17.479 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:41:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:17 trial034 ceph-mon[21825]: pgmap v550: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 42 MiB/s wr, 3.15k op/s 2026-02-18T03:41:17.524 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.525 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:41:17.570 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.571 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:41:17.617 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.618 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:41:17.664 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.665 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:41:17.710 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.710 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:41:17.794 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.796 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:41:17.840 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.841 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:41:17.885 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.887 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:41:17.931 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.931 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:41:17.975 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:17.976 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:41:18.021 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.022 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:41:18.068 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.068 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:41:18.114 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.115 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:41:18.160 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.161 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:41:18.205 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.207 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:41:18.251 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.252 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:41:18.297 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.299 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:41:18.343 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.344 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:41:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1375752592' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:18.429 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.429 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:41:18.473 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.474 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:41:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:18 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1375752592' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:18.519 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:41:18.520 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:41:18.520 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:41:18.520 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:41:18.520 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:41:18.520 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:41:18.521 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.d 2026-02-18T03:41:18.521 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon stop nvmeof.nvmeof.d 2026-02-18T03:41:18.521 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:41:18.521 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:41:18.522 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:41:18.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:41:18 trial034 ceph-mon[21825]: from='client.? 10.20.193.177:0/1375752592' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:18.714 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to stop nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:41:18.724 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 79 secs before reviving 2026-02-18T03:41:18.767 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":86,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:41:18.779 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:41:18.779 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:41:18.779 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:41:18.779 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:41:18.860 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:41:18.860 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:18.860 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 1028285, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 86, 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:18.861 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.862 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.863 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [ 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.864 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.865 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.866 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:41:18.867 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.868 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:18.869 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.870 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:18.871 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.872 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.873 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:41:18.874 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.875 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "num": 7 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.876 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "num": 90 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.877 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:41:18.878 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:41:18.879 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:41:18.879 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:41:18.880 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:41:18.958 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:41:18.958 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:18.958 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 87018, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 86, 2026-02-18T03:41:18.959 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.960 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.961 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:41:18.962 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:41:18.963 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:18.964 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.965 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.966 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.967 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.968 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.969 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:41:18.970 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:18.971 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: "num": 34 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:41:18.972 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:41:18.974 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:41:18.974 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:41:18.974 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:41:19.053 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 38, 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 245395, 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:41:19.054 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 86, 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:19.055 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:19.056 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.057 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:41:19.058 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:19.059 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:19.060 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.061 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:19.062 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.063 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.064 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:41:19.065 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:19.066 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:19.067 INFO:teuthology.orchestra.run.trial034.stdout: "num": 24 2026-02-18T03:41:19.068 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:19.068 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:19.068 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:19.068 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:41:19.068 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:41:19.069 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:41:19.069 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['a'] 2026-02-18T03:41:19.070 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:41:19.070 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.a 2026-02-18T03:41:19.070 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.a 2026-02-18T03:41:19.070 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-18T03:41:19.070 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:41:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:18 trial177 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:41:19.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:18] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:41:19.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:19] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:41:19.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:19] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.177:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.177:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:41:19.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:19 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:19] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:41:19.279 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service' 2026-02-18T03:41:19.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:41:19.318 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-18T03:41:19.318 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:41:19.318 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: pgmap v551: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.46k op/s 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3982193035' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:19 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: pgmap v551: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.46k op/s 2026-02-18T03:41:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3982193035' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:19 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:19.591 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":87,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial177) 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:41:20.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 podman[74206]: 2026-02-18 03:41:20.59894689 +0000 UTC m=+1.612301035 container died 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.branch=undefined, io.ceph.version=1.6.5, build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , io.spdk.version=25.09, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.repo=https://github.com/ceph/spdk.git, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, name=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 podman[74206]: 2026-02-18 03:41:20.610576505 +0000 UTC m=+1.623930650 container remove 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.wants=ceph,rbd, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, name=ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://github.com/ceph/ceph-nvmeof, release=, architecture=x86_64, org.centos.version=9.0-30.el9, io.spdk.build.target-arch=x86-64-v2, io.ceph.component=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.ceph.nvmeof=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.spdk.build.makeflags=, io.ceph.version=1.6.5, version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd) 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 bash[74206]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:41:20.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 5min 48.590s CPU time, 348.7M memory peak. 2026-02-18T03:41:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 141.70 1.8M 2.0M 0.0k 18.2M 19.8M 0.0k nvme12n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 138.30 1.7M 1.9M 0.0k 17.2M 18.8M 0.0k nvme16n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 154.00 2.0M 1.9M 0.0k 20.4M 19.4M 0.0k nvme20n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 145.40 2.0M 2.0M 0.0k 19.8M 19.8M 0.0k nvme24n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 153.30 2.1M 2.0M 0.0k 21.0M 19.8M 0.0k nvme28n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 146.70 1.8M 1.9M 0.0k 18.1M 19.2M 0.0k nvme32n3 2026-02-18T03:41:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 148.40 2.0M 1.9M 0.0k 20.2M 19.4M 0.0k nvme36n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 147.80 1.9M 2.0M 0.0k 19.2M 19.6M 0.0k nvme40n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 145.20 1.9M 2.0M 0.0k 19.3M 20.3M 0.0k nvme44n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 149.30 2.0M 1.8M 0.0k 20.0M 18.2M 0.0k nvme48n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 139.60 1.8M 1.9M 0.0k 18.2M 19.3M 0.0k nvme4n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 145.30 2.0M 2.0M 0.0k 20.3M 19.9M 0.0k nvme52n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 148.30 2.0M 1.9M 0.0k 20.3M 19.4M 0.0k nvme56n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 144.60 2.0M 2.0M 0.0k 19.8M 20.0M 0.0k nvme60n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 146.90 1.9M 2.1M 0.0k 19.3M 20.6M 0.0k nvme64n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 146.70 2.0M 1.9M 0.0k 20.4M 18.8M 0.0k nvme8n3 2026-02-18T03:41:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:22.602 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:41:22.834 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":90,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:41:25.844 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:41:26.078 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":93,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:41:29.089 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:41:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:31.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme12n3 2026-02-18T03:41:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme16n3 2026-02-18T03:41:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme20n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme24n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme28n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme32n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme36n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme40n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme44n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme48n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme4n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme52n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme56n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme60n3 2026-02-18T03:41:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme64n3 2026-02-18T03:41:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2026-02-18T03:41:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:34.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1937046735' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1973480698' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3037972346' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v552: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.01k op/s 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v553: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 2.94k op/s 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2107184073' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1922059159' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v554: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 2.93k op/s 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v555: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 26 MiB/s wr, 2.00k op/s 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3615389842' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1744552617' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/720604236' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v556: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 20 MiB/s wr, 1.58k op/s 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: mon.b calling monitor election 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: mon.c calling monitor election 2026-02-18T03:41:34.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v557: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 10 MiB/s rd, 10 MiB/s wr, 831 op/s 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: pgmap v558: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 538 op/s 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: monmap epoch 3 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: min_mon_release 20 (tentacle) 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: election_strategy: 1 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:41:34.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: fsmap 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: mgrmap e15: x(active, since 17m) 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:34.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:34 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1937046735' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1973480698' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3037972346' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v552: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.01k op/s 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v553: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 2.94k op/s 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2107184073' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1922059159' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v554: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 2.93k op/s 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v555: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 26 MiB/s rd, 26 MiB/s wr, 2.00k op/s 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3615389842' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1744552617' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/720604236' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v556: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 20 MiB/s wr, 1.58k op/s 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:41:34.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v557: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 10 MiB/s rd, 10 MiB/s wr, 831 op/s 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: pgmap v558: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 538 op/s 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:41:34.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: osdmap e56: 8 total, 8 up, 8 in 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 17m) 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:34.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:34 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:41:35.320 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":40,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:41:35.331 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:41:35.331 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:41:35.332 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:41:35.408 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:41:35.408 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:35.408 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:35.408 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 40, 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 103466, 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:41:35.409 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.410 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.411 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:41:35.412 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:41:35.413 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.414 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.415 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:41:35.416 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:35.417 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.418 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.419 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.420 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.421 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "num": 6 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "num": 80 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:41:35.422 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:41:35.423 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:41:35.425 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:41:35.425 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon c 2026-02-18T03:41:35.425 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:41:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: pgmap v559: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 299 op/s 2026-02-18T03:41:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:41:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:41:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 40, 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 261842, 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:41:35.501 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.502 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:41:35.503 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.504 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:41:35.505 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:41:35.506 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.507 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:41:35.508 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:41:35.509 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.510 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:41:35.511 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.512 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.513 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:41:35.514 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "num": 31 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:41:35.515 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:41:35.516 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:41:35.516 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:41:35.516 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:41:35.517 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:41:35.517 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: pgmap v559: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 299 op/s 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:41:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:41:35.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:41:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1028844067' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3562761888' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:36.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:36.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:36.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:36 trial086 ceph-mon[98535]: pgmap v560: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 88 KiB/s rd, 0 B/s wr, 15 op/s 2026-02-18T03:41:36.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1028844067' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:41:36.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:36.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:36.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3562761888' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:36.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:41:36.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:41:36.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:36 trial155 ceph-mon[87919]: pgmap v560: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 88 KiB/s rd, 0 B/s wr, 15 op/s 2026-02-18T03:41:39.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:38 trial155 ceph-mon[87919]: pgmap v561: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:41:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:38 trial086 ceph-mon[98535]: pgmap v561: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:41:41.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:40 trial155 ceph-mon[87919]: pgmap v562: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:41:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:40 trial086 ceph-mon[98535]: pgmap v562: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:41:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme12n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme16n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme20n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme24n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme28n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme32n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme36n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme40n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme44n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme48n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme4n3 2026-02-18T03:41:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme52n3 2026-02-18T03:41:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme56n3 2026-02-18T03:41:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme60n3 2026-02-18T03:41:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme64n3 2026-02-18T03:41:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2026-02-18T03:41:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:42.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:41:41] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:41:42.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:54574 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:41.948364] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000161 seconds 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:41.964355] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000186 seconds 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:41.980322] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000183 seconds 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:41.997301] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000186 seconds 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.029403] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000206 seconds 2026-02-18T03:41:42.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.045433] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000231 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.061428] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000219 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.077434] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000210 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.093493] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000271 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.109490] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000265 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.125485] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000247 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.149489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000221 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.165480] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000221 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.181540] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000262 seconds 2026-02-18T03:41:42.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.197541] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000267 seconds 2026-02-18T03:41:42.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1858389569' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:42.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2867467868' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:42.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:41 trial155 ceph-mon[87919]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:41:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1858389569' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2867467868' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:41 trial086 ceph-mon[98535]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:41:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:42 trial155 ceph-mon[87919]: pgmap v564: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 67 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:41:43.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:42 trial155 ceph-mon[87919]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:41:43.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:42 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3786992580' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:42 trial086 ceph-mon[98535]: pgmap v564: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 67 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:41:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:42 trial086 ceph-mon[98535]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:41:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3786992580' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:45.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:44 trial155 ceph-mon[87919]: pgmap v565: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2026-02-18T03:41:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:44 trial086 ceph-mon[98535]: pgmap v565: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2026-02-18T03:41:47.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:46 trial155 ceph-mon[87919]: pgmap v566: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 452 op/s 2026-02-18T03:41:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:46 trial086 ceph-mon[98535]: pgmap v566: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 452 op/s 2026-02-18T03:41:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:48 trial155 ceph-mon[87919]: pgmap v567: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 953 op/s 2026-02-18T03:41:49.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3958718402' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:49.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/453681443' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:48 trial086 ceph-mon[98535]: pgmap v567: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 953 op/s 2026-02-18T03:41:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3958718402' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/453681443' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:50.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:49 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3366246243' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3366246243' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:50 trial155 ceph-mon[87919]: pgmap v568: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 1.71k op/s 2026-02-18T03:41:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:50 trial086 ceph-mon[98535]: pgmap v568: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 22 MiB/s rd, 22 MiB/s wr, 1.71k op/s 2026-02-18T03:41:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.5M 2.5M 0.0k 24.6M 24.9M 0.0k nvme12n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.6M 2.5M 0.0k 25.9M 24.9M 0.0k nvme16n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 187.00 2.3M 2.4M 0.0k 23.2M 24.2M 0.0k nvme20n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 187.30 2.4M 2.5M 0.0k 23.7M 25.1M 0.0k nvme24n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 190.30 2.4M 2.4M 0.0k 24.3M 24.2M 0.0k nvme28n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.4M 2.5M 0.0k 23.9M 24.5M 0.0k nvme32n3 2026-02-18T03:41:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.4M 2.5M 0.0k 24.2M 24.8M 0.0k nvme36n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 2.5M 2.5M 0.0k 24.8M 24.9M 0.0k nvme40n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 188.90 2.5M 2.4M 0.0k 25.1M 24.2M 0.0k nvme44n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.5M 2.5M 0.0k 24.5M 24.5M 0.0k nvme48n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.6M 2.6M 0.0k 26.3M 25.7M 0.0k nvme4n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.7M 2.5M 0.0k 26.8M 25.3M 0.0k nvme52n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 187.40 2.5M 2.5M 0.0k 24.8M 24.7M 0.0k nvme56n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 189.00 2.5M 2.5M 0.0k 25.3M 24.6M 0.0k nvme60n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.30 2.5M 2.5M 0.0k 25.3M 25.4M 0.0k nvme64n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.80 2.6M 2.5M 0.0k 25.9M 25.4M 0.0k nvme8n3 2026-02-18T03:41:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:41:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:52 trial155 ceph-mon[87919]: pgmap v569: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 25 MiB/s wr, 1.98k op/s 2026-02-18T03:41:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:52 trial086 ceph-mon[98535]: pgmap v569: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 25 MiB/s rd, 25 MiB/s wr, 1.98k op/s 2026-02-18T03:41:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:54 trial155 ceph-mon[87919]: pgmap v570: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.64k op/s 2026-02-18T03:41:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:54 trial086 ceph-mon[98535]: pgmap v570: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.64k op/s 2026-02-18T03:41:56.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3322330105' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:56.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1642748710' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3322330105' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1642748710' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:56 trial155 ceph-mon[87919]: pgmap v571: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.95k op/s 2026-02-18T03:41:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/4163369622' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:56 trial086 ceph-mon[98535]: pgmap v571: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.95k op/s 2026-02-18T03:41:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4163369622' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:41:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:41:58 trial155 ceph-mon[87919]: pgmap v572: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.11k op/s 2026-02-18T03:41:59.287 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:41:58 trial086 ceph-mon[98535]: pgmap v572: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.11k op/s 2026-02-18T03:42:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:00 trial155 ceph-mon[87919]: pgmap v573: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.34k op/s 2026-02-18T03:42:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:00 trial086 ceph-mon[98535]: pgmap v573: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.34k op/s 2026-02-18T03:42:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.5M 2.5M 0.0k 25.2M 25.5M 0.0k nvme12n3 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.5M 2.5M 0.0k 25.5M 25.3M 0.0k nvme16n3 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.4M 2.5M 0.0k 23.9M 24.8M 0.0k nvme20n3 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.00 2.6M 2.5M 0.0k 26.5M 25.4M 0.0k nvme24n3 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 2.7M 2.5M 0.0k 26.7M 25.1M 0.0k nvme28n3 2026-02-18T03:42:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.50 2.5M 2.4M 0.0k 24.9M 24.3M 0.0k nvme32n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.4M 2.4M 0.0k 24.2M 24.1M 0.0k nvme36n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.4M 2.5M 0.0k 23.8M 25.2M 0.0k nvme40n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.6M 2.5M 0.0k 25.5M 24.9M 0.0k nvme44n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 2.3M 2.5M 0.0k 23.1M 24.8M 0.0k nvme48n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.00 2.5M 2.5M 0.0k 25.4M 24.7M 0.0k nvme4n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.5M 2.6M 0.0k 25.2M 25.9M 0.0k nvme52n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.30 2.5M 2.5M 0.0k 24.5M 24.8M 0.0k nvme56n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 2.8M 2.6M 0.0k 27.8M 25.6M 0.0k nvme60n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.6M 2.5M 0.0k 25.6M 24.6M 0.0k nvme64n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.5M 2.5M 0.0k 24.6M 24.9M 0.0k nvme8n3 2026-02-18T03:42:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:03.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:02 trial155 ceph-mon[87919]: pgmap v574: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.00k op/s 2026-02-18T03:42:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3966920741' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:03.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3103546993' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:02 trial086 ceph-mon[98535]: pgmap v574: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.00k op/s 2026-02-18T03:42:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3966920741' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3103546993' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:04.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:03 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2819349895' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2819349895' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:04 trial086 ceph-mon[98535]: pgmap v575: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.63k op/s 2026-02-18T03:42:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:04 trial155 ceph-mon[87919]: pgmap v575: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.63k op/s 2026-02-18T03:42:07.296 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:06 trial155 ceph-mon[87919]: pgmap v576: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.13k op/s 2026-02-18T03:42:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:06 trial086 ceph-mon[98535]: pgmap v576: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.13k op/s 2026-02-18T03:42:09.339 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:08 trial086 ceph-mon[98535]: pgmap v577: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.13k op/s 2026-02-18T03:42:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:08 trial155 ceph-mon[87919]: pgmap v577: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.13k op/s 2026-02-18T03:42:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1063125237' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/276337444' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1063125237' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:09 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/276337444' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:10 trial086 ceph-mon[98535]: pgmap v578: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.35k op/s 2026-02-18T03:42:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:10 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2848657248' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:10 trial155 ceph-mon[87919]: pgmap v578: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.35k op/s 2026-02-18T03:42:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:10 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2848657248' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.5M 2.4M 0.0k 25.1M 24.2M 0.0k nvme12n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.4M 2.4M 0.0k 24.0M 24.2M 0.0k nvme16n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.3M 2.5M 0.0k 23.2M 25.3M 0.0k nvme20n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 2.5M 2.5M 0.0k 24.5M 25.3M 0.0k nvme24n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.4M 2.4M 0.0k 24.0M 24.2M 0.0k nvme28n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.00 2.3M 2.4M 0.0k 23.3M 23.5M 0.0k nvme32n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 2.5M 2.5M 0.0k 25.2M 24.7M 0.0k nvme36n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.5M 2.4M 0.0k 24.6M 24.0M 0.0k nvme40n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.4M 2.4M 0.0k 23.7M 23.8M 0.0k nvme44n3 2026-02-18T03:42:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 2.3M 2.4M 0.0k 23.5M 23.9M 0.0k nvme48n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.5M 2.4M 0.0k 24.6M 24.3M 0.0k nvme4n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.6M 2.4M 0.0k 26.0M 24.3M 0.0k nvme52n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.6M 2.4M 0.0k 25.8M 24.1M 0.0k nvme56n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.4M 2.3M 0.0k 23.8M 23.3M 0.0k nvme60n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 2.4M 2.5M 0.0k 23.8M 25.2M 0.0k nvme64n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.3M 2.4M 0.0k 23.0M 24.2M 0.0k nvme8n3 2026-02-18T03:42:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:12 trial086 ceph-mon[98535]: pgmap v579: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.00k op/s 2026-02-18T03:42:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:12 trial155 ceph-mon[87919]: pgmap v579: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.00k op/s 2026-02-18T03:42:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:14 trial086 ceph-mon[98535]: pgmap v580: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 3.63k op/s 2026-02-18T03:42:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:14 trial155 ceph-mon[87919]: pgmap v580: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 3.63k op/s 2026-02-18T03:42:17.348 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:16 trial155 ceph-mon[87919]: pgmap v581: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.12k op/s 2026-02-18T03:42:17.348 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2842077601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:17.348 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3850329960' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:16 trial086 ceph-mon[98535]: pgmap v581: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.12k op/s 2026-02-18T03:42:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2842077601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3850329960' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:17 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/175686697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:17 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/175686697' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:18 trial086 ceph-mon[98535]: pgmap v582: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.12k op/s 2026-02-18T03:42:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:18 trial155 ceph-mon[87919]: pgmap v582: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.12k op/s 2026-02-18T03:42:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:21 trial086 ceph-mon[98535]: pgmap v583: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.32k op/s 2026-02-18T03:42:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:21 trial155 ceph-mon[87919]: pgmap v583: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.32k op/s 2026-02-18T03:42:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.3M 2.4M 0.0k 22.9M 24.5M 0.0k nvme12n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.70 2.1M 2.3M 0.0k 21.4M 23.2M 0.0k nvme16n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.3M 2.4M 0.0k 23.1M 23.7M 0.0k nvme20n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 188.30 2.2M 2.3M 0.0k 21.6M 23.2M 0.0k nvme24n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.3M 2.3M 0.0k 23.1M 23.2M 0.0k nvme28n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.3M 2.3M 0.0k 22.6M 22.5M 0.0k nvme32n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.70 2.3M 2.4M 0.0k 22.6M 24.2M 0.0k nvme36n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 2.2M 2.4M 0.0k 22.3M 23.9M 0.0k nvme40n3 2026-02-18T03:42:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.3M 2.3M 0.0k 22.8M 23.3M 0.0k nvme44n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.00 2.4M 2.4M 0.0k 23.6M 23.7M 0.0k nvme48n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.30 2.3M 2.4M 0.0k 22.8M 24.0M 0.0k nvme4n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 191.30 2.2M 2.4M 0.0k 22.2M 24.3M 0.0k nvme52n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.90 2.5M 2.5M 0.0k 25.3M 24.8M 0.0k nvme56n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 2.2M 2.4M 0.0k 21.6M 23.9M 0.0k nvme60n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.30 2.2M 2.4M 0.0k 22.5M 24.3M 0.0k nvme64n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.3M 2.3M 0.0k 22.9M 23.4M 0.0k nvme8n3 2026-02-18T03:42:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:23 trial086 ceph-mon[98535]: pgmap v584: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 2.97k op/s 2026-02-18T03:42:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:23 trial155 ceph-mon[87919]: pgmap v584: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 2.97k op/s 2026-02-18T03:42:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:24 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/973119924' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:24.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:24 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/825911843' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:24 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/973119924' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:24 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/825911843' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:25 trial086 ceph-mon[98535]: pgmap v585: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.59k op/s 2026-02-18T03:42:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:25 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/277012126' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:25 trial155 ceph-mon[87919]: pgmap v585: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.59k op/s 2026-02-18T03:42:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:25 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/277012126' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:27 trial086 ceph-mon[98535]: pgmap v586: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 37 MiB/s wr, 3.09k op/s 2026-02-18T03:42:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:27 trial155 ceph-mon[87919]: pgmap v586: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 37 MiB/s wr, 3.09k op/s 2026-02-18T03:42:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:29 trial086 ceph-mon[98535]: pgmap v587: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.09k op/s 2026-02-18T03:42:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:29 trial155 ceph-mon[87919]: pgmap v587: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.09k op/s 2026-02-18T03:42:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:31 trial086 ceph-mon[98535]: pgmap v588: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.30k op/s 2026-02-18T03:42:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3369619302' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4149843884' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:31 trial155 ceph-mon[87919]: pgmap v588: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.30k op/s 2026-02-18T03:42:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:31 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3369619302' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:31 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4149843884' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 2.4M 2.3M 0.0k 24.0M 22.6M 0.0k nvme12n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.3M 2.3M 0.0k 22.6M 22.8M 0.0k nvme16n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 2.2M 2.4M 0.0k 21.9M 23.6M 0.0k nvme20n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.20 2.2M 2.3M 0.0k 21.6M 22.7M 0.0k nvme24n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.80 2.1M 2.3M 0.0k 21.4M 23.0M 0.0k nvme28n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 2.3M 2.2M 0.0k 22.9M 22.3M 0.0k nvme32n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.2M 2.4M 0.0k 21.9M 23.9M 0.0k nvme36n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.2M 2.2M 0.0k 22.4M 22.4M 0.0k nvme40n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 2.2M 2.1M 0.0k 22.2M 21.0M 0.0k nvme44n3 2026-02-18T03:42:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 2.2M 2.3M 0.0k 22.5M 22.7M 0.0k nvme48n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.3M 2.2M 0.0k 22.9M 22.3M 0.0k nvme4n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 191.20 2.2M 2.2M 0.0k 22.0M 22.5M 0.0k nvme52n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.1M 2.3M 0.0k 21.3M 23.0M 0.0k nvme56n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.3M 2.3M 0.0k 23.0M 23.2M 0.0k nvme60n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 2.2M 2.3M 0.0k 21.6M 22.7M 0.0k nvme64n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 2.3M 2.3M 0.0k 23.4M 23.3M 0.0k nvme8n3 2026-02-18T03:42:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:32 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/384958219' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:32 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/384958219' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:33 trial086 ceph-mon[98535]: pgmap v589: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.96k op/s 2026-02-18T03:42:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:33 trial155 ceph-mon[87919]: pgmap v589: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.96k op/s 2026-02-18T03:42:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: pgmap v590: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.59k op/s 2026-02-18T03:42:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:35.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:35.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:35.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:35 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: pgmap v590: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.59k op/s 2026-02-18T03:42:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:35.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:35 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:35.518 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:42:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:37 trial086 ceph-mon[98535]: pgmap v591: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:37 trial155 ceph-mon[87919]: pgmap v591: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:37.724 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #5: thrashed- nvmeof.d (by ceph_daemon_stop); 2026-02-18T03:42:37.724 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:42:37.725 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:42:37.756 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:37.756 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:42:37.756 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 6min ago 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 377.8M (peak: 379.5M) 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 27min 3.197s 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.757 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.045433] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000231 seconds 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.061428] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000219 seconds 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.077434] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000210 seconds 2026-02-18T03:42:37.758 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.093493] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000271 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.109490] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000265 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.125485] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000247 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.149489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000221 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.165480] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000221 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.181540] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000262 seconds 2026-02-18T03:42:37.759 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:41:42 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:41:42.197541] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000267 seconds 2026-02-18T03:42:37.760 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:42:37.791 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 2min 45s ago 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 341.8M (peak: 344.4M) 2026-02-18T03:42:37.792 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 10min 50.633s 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:42:37.793 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.031957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_23 elapsed time: 0.000171 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.047952] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000164 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.063923] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000134 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.079935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000145 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.103929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000136 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.119941] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000146 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.135957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000165 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.151975] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000175 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.167927] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000131 seconds 2026-02-18T03:42:37.794 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.183926] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000133 seconds 2026-02-18T03:42:37.796 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:42:37.829 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:37.829 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:42:37.829 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 8min ago 2026-02-18T03:42:37.829 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 373.2M (peak: 376.7M) 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 33min 51.960s 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:42:37.831 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:42:37.831 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:42:37.831 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:42:37.831 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:42:37.831 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:42:37.832 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:42:37.832 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:42:37.832 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:42:37.832 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:42:37.833 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:42:37.833 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:42:37.833 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:42:37.833 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:42:37.833 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:38580 2026-02-18T03:42:37.833 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:42:37.876 INFO:teuthology.orchestra.run.trial177.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:37.876 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:42:37.876 INFO:teuthology.orchestra.run.trial177.stdout: Active: inactive (dead) since Wed 2026-02-18 03:41:20 UTC; 1min 17s ago 2026-02-18T03:42:37.876 INFO:teuthology.orchestra.run.trial177.stdout: Duration: 1min 26.076s 2026-02-18T03:42:37.876 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63758 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: Process: 63759 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74173 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74240 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74274 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 63839 (code=exited, status=0/SUCCESS) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 5min 48.590s 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:42:37.877 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[63839]: [18-Feb-2026 03:41:20] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d/nvmeof-log.gz 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 podman[74206]: 2026-02-18 03:41:20.59894689 +0000 UTC m=+1.612301035 container died 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, maintainer=Ceph Developers , io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.branch=undefined, io.ceph.version=1.6.5, build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.maintainer=Ceph Developers , io.spdk.version=25.09, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.repo=https://github.com/ceph/spdk.git, url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, name=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 podman[74206]: 2026-02-18 03:41:20.610576505 +0000 UTC m=+1.623930650 container remove 5546f1f79e4f95ee60101f1d5ca860855c196b9c37a3a32167208c35443bdfc5 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.wants=ceph,rbd, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, name=ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://github.com/ceph/ceph-nvmeof, release=, architecture=x86_64, org.centos.version=9.0-30.el9, io.spdk.build.target-arch=x86-64-v2, io.ceph.component=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.ceph.nvmeof=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.spdk.build.makeflags=, io.ceph.version=1.6.5, version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.buildah.version=1.29.0, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd) 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 bash[74206]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Deactivated successfully. 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:42:37.878 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:41:20 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 5min 48.590s CPU time, 348.7M memory peak. 2026-02-18T03:42:37.879 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:42:37.879 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:42:38.103 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:42:38.103 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 5m ago 17m trial034=x;count:1 2026-02-18T03:42:38.103 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 8m ago 17m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:42:38.103 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 3/4 8m ago 16m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:42:38.104 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 8m ago 16m trial155 2026-02-18T03:42:38.112 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:42:38.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3401821913' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:38.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/378846790' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:38.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3401821913' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:38.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:38 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/378846790' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:38.289 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:42:38.290 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (6m) 5m ago 6m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:42:38.290 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (2m) 2m ago 6m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:42:38.290 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (8m) 8m ago 12m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:42:38.290 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 stopped 64s ago 6m - - 2026-02-18T03:42:38.297 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:42:38.508 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum c,b; 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:38.508 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:42:38.508 INFO:teuthology.orchestra.run.trial177.stdout: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:42:38.508 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:38.508 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.d' is unavailable. 2026-02-18T03:42:38.515 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:42:38.729 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:42:38.729 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:38.729 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum c,b 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum c,b (age 64s) [leader: c], out of quorum: a 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 18m) 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 16m), 8 in (since 16m) 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 3 gateways active (3 hosts) 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:42:38.730 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: usage: 50 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: client: 34 MiB/s rd, 35 MiB/s wr, 1.53k op/s rd, 1.55k op/s wr 2026-02-18T03:42:38.731 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:42:38.738 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:42:38.974 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 192, 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 3, 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 118, 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:42:38.975 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:42:38.976 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:42:38.977 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:42:38.978 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:42:38.979 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:42:38.979 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:42:38.979 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:42:38.983 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.041 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.042 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.043 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.044 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.045 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.046 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:42:39.048 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:42:39.093 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.094 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:42:39.138 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.140 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:42:39.184 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.185 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:42:39.230 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.230 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:42:39.274 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.276 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:42:39.320 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.322 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:42:39.366 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.368 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: pgmap v592: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: from='client.100691 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3529103254' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4015443322' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4124823929' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:42:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3752001483' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:42:39.412 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.413 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:42:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: pgmap v592: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: from='client.100691 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3529103254' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:42:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/4015443322' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4124823929' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:42:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:39 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3752001483' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:42:39.496 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.498 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:42:39.542 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.543 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:42:39.589 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.589 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:42:39.633 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.634 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:42:39.718 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.719 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:42:39.764 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.765 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:42:39.812 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.812 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:42:39.857 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.858 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:42:39.904 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.904 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:42:39.948 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.949 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:42:39.993 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:39.994 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:42:40.038 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.040 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:42:40.084 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.085 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:42:40.171 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.172 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:42:40.217 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.218 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:42:40.261 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.263 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:42:40.307 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.309 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:42:40.353 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.354 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:42:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:40 trial086 ceph-mon[98535]: from='client.100697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:40.441 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.442 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:42:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:40 trial155 ceph-mon[87919]: from='client.100697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:40.486 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.488 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:42:40.532 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.533 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:42:40.577 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.579 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:42:40.624 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.625 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:42:40.669 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.670 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:42:40.716 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.717 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:42:40.762 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.763 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:42:40.809 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.809 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:42:40.854 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.855 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:42:40.901 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.901 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:42:40.947 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.948 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:42:40.992 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:40.994 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:42:41.039 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.046 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:42:41.122 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.123 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:42:41.223 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.225 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:42:41.270 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.271 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:42:41.326 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.327 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:42:41.372 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.373 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:42:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:41 trial086 ceph-mon[98535]: pgmap v593: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.28k op/s 2026-02-18T03:42:41.425 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.425 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:42:41.470 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.471 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:42:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:41 trial155 ceph-mon[87919]: pgmap v593: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.28k op/s 2026-02-18T03:42:41.516 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.516 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:42:41.562 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.563 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:42:41.608 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.609 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:42:41.653 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.655 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:42:41.700 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.701 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:42:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.1M 2.3M 0.0k 20.7M 22.5M 0.0k nvme12n3 2026-02-18T03:42:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 2.1M 2.3M 0.0k 21.2M 22.7M 0.0k nvme16n3 2026-02-18T03:42:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.1M 2.3M 0.0k 21.2M 22.5M 0.0k nvme20n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.3M 2.2M 0.0k 23.4M 22.0M 0.0k nvme24n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.70 2.2M 2.1M 0.0k 21.8M 21.5M 0.0k nvme28n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.2M 2.1M 0.0k 21.6M 21.0M 0.0k nvme32n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.2M 2.2M 0.0k 22.2M 22.4M 0.0k nvme36n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.3M 2.1M 0.0k 23.3M 21.1M 0.0k nvme40n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.1M 2.2M 0.0k 20.6M 22.4M 0.0k nvme44n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.3M 2.2M 0.0k 22.6M 22.1M 0.0k nvme48n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.2M 2.2M 0.0k 22.1M 22.2M 0.0k nvme4n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.80 2.2M 2.3M 0.0k 22.0M 22.8M 0.0k nvme52n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.2M 2.1M 0.0k 22.0M 21.5M 0.0k nvme56n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 2.3M 2.3M 0.0k 23.2M 22.6M 0.0k nvme60n3 2026-02-18T03:42:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.3M 2.3M 0.0k 23.2M 22.7M 0.0k nvme64n3 2026-02-18T03:42:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.1M 2.1M 0.0k 21.3M 21.1M 0.0k nvme8n3 2026-02-18T03:42:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:41.746 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.747 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:42:41.833 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.834 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:42:41.879 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.880 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:42:41.924 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.925 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:42:41.971 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:41.972 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:42:42.016 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.018 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:42:42.063 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.064 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:42:42.110 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.112 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:42:42.156 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.157 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:42:42.244 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.245 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:42:42.290 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.291 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:42:42.335 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:42:42.336 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:42:42.336 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:42:42.337 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.d 2026-02-18T03:42:42.337 DEBUG:teuthology.orchestra.run.trial177:> ceph orch daemon restart nvmeof.nvmeof.d --force 2026-02-18T03:42:42.337 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:42:42.337 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.a 2026-02-18T03:42:42.337 INFO:tasks.cephadm.mon.a:Restarting mon.a (starting--it wasn't running)... 2026-02-18T03:42:42.338 DEBUG:teuthology.orchestra.run.trial034:mon.a> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service 2026-02-18T03:42:42.340 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:42:42.532 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled to restart nvmeof.nvmeof.d on host 'trial177' 2026-02-18T03:42:42.542 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 77 secs before thrashing 2026-02-18T03:42:42.559 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:42:42.560 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:42:42.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 systemd[1]: Starting Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 podman[109535]: 2026-02-18 03:42:42.511808741 +0000 UTC m=+0.018927780 container create 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 podman[109535]: 2026-02-18 03:42:42.549983872 +0000 UTC m=+0.057102861 container init 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216) 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 podman[109535]: 2026-02-18 03:42:42.552317454 +0000 UTC m=+0.059436444 container start 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216) 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 bash[109535]: 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 podman[109535]: 2026-02-18 03:42:42.504577497 +0000 UTC m=+0.011696496 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 systemd[1]: Started Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:42:42.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: pidfile_write: ignore empty --pid-file 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: load: jerasure load: lrc 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Git sha 0 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: DB SUMMARY 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: DB Session ID: SG0650T5O2OJUGC7RPMA 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: MANIFEST file: MANIFEST-000015 size: 2202 Bytes 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000041.sst 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000039.log size: 427366 ; 2026-02-18T03:42:42.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.env: 0x55a185b68100 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.info_log: 0x55a18b5e0e80 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.statistics: (nil) 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.use_fsync: 0 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:42:42.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.db_log_dir: 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.wal_dir: 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:42:42.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.write_buffer_manager: 0x55a18b5e4b40 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:42:42.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.unordered_write: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.row_cache: None 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.wal_filter: None 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:42:42.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.wal_compression: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:42:42.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:42:42.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:42:42.780 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:42:42.780 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:42:42.780 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_open_files: -1 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Compression algorithms supported: 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kZSTD supported: 0 2026-02-18T03:42:42.781 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.merge_operator: 2026-02-18T03:42:42.782 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_filter: None 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a18b5e03c0) 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: index_type: 0 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_index_type: 0 2026-02-18T03:42:42.783 INFO:journalctl@ceph.mon.a.trial034.stdout: index_shortening: 1 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: checksum: 4 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: no_block_cache: 0 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache: 0x55a18b601b90 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_options: 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: capacity : 536870912 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: num_shard_bits : 4 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: strict_capacity_limit : 0 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_compressed: (nil) 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: persistent_cache: (nil) 2026-02-18T03:42:42.784 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size: 4096 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size_deviation: 10 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: block_restart_interval: 16 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: index_block_restart_interval: 1 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: metadata_block_size: 4096 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: partition_filters: 0 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: use_delta_encoding: 1 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: filter_policy: bloomfilter 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: whole_key_filtering: 1 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_compression: 0 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: format_version: 5 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_index_compression: 1 2026-02-18T03:42:42.785 INFO:journalctl@ceph.mon.a.trial034.stdout: block_align: 0 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout: max_auto_readahead_size: 262144 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout: prepopulate_block_cache: 0 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression: NoCompression 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.num_levels: 7 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:42:42.786 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:42:42.787 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:42:42.788 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:42:42.789 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:42:42.790 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.ttl: 2592000 2026-02-18T03:42:42.791 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:42:42.792 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 43, last_sequence is 19774, log_number is 39,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 39 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 39 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8df5c88d-f7b2-4851-aabb-a44400590142 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386162583315, "job": 1, "event": "recovery_started", "wal_files": [39]} 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #39 mode 2 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386162585241, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 44, "file_size": 419225, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19775, "largest_seqno": 20222, "table_properties": {"data_size": 416405, "index_size": 1269, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 4343, "raw_average_key_size": 22, "raw_value_size": 412276, "raw_average_value_size": 2092, "num_data_blocks": 58, "num_entries": 197, "num_filter_entries": 197, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771386162, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8df5c88d-f7b2-4851-aabb-a44400590142", "db_session_id": "SG0650T5O2OJUGC7RPMA", "orig_file_number": 44, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386162585303, "job": 1, "event": "recovery_finished"} 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:5047] Creating manifest 46 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000039.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a18b604700 2026-02-18T03:42:42.793 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: DB pointer 0x55a18b616000 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: ** DB Stats ** 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.794 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: L0 1/0 409.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 326.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: L6 1/0 8.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: Sum 2/0 8.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 326.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 326.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 326.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:42:42.795 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative compaction: 0.00 GB write, 101.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval compaction: 0.00 GB write, 101.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache BinnedLRUCache@0x55a18b601b90#2 capacity: 512.00 MB usage: 1.93 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2026-02-18T03:42:42.796 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.60 KB,0.000114739%) IndexBlock(1,1.33 KB,0.00025332%) Misc(1,0.00 KB,0%) 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: starting mon.a rank 0 at public addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] at bind addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).mds e1 new map 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).mds e1 print_map 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: e1 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:42:42.797 INFO:journalctl@ceph.mon.a.trial034.stdout: legacy client fscid: -1 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout: No filesystems configured 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).osd e56 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).osd e56 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).osd e56 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).osd e56 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:42:42.798 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:42 trial034 ceph-mon[109579]: mon.a@-1(???).paxosservice(auth 1..44) refresh upgraded, format 0 -> 3 2026-02-18T03:42:42.816 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":40,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":68,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:42:43.007 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:42 trial177 systemd[1]: Starting Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:42:43.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 podman[75020]: 2026-02-18 03:42:43.005671462 +0000 UTC m=+0.017496551 container create 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, release=, version=1.6.5, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.openshift.wants=ceph,rbd, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.ceph-release=20.2.0, com.redhat.component=ubi9-container, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.component=ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, vcs-type=git, vendor=Red Hat, Inc., architecture=x86_64, io.spdk.git.branch=undefined, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.pkgdep-args=--rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , org.centos.version=9.0-30.el9, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.nvmeof=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, maintainer=Ceph Developers , url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:42:43.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 podman[75020]: 2026-02-18 03:42:43.032984959 +0000 UTC m=+0.044809978 container init 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, build-date=2026-02-11 09:53:49 UTC, io.spdk.version=25.09, io.spdk.build.target-arch=x86-64-v2, io.ceph.version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, com.redhat.component=ubi9-container, io.ceph.maintainer=Ceph Developers , version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.buildah.version=1.29.0, vcs-type=git, org.centos.version=9.0-30.el9, release=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, distribution-scope=public, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, maintainer=Ceph Developers , io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.branch=devel, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.nvmeof=, io.spdk.build.ceph-release=20.2.0, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:42:43.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 podman[75020]: 2026-02-18 03:42:43.035224051 +0000 UTC m=+0.047049080 container start 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, name=ceph-nvmeof, org.centos.version=9.0-30.el9, vendor=Red Hat, Inc., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, io.ceph.version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, architecture=x86_64, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.version=25.09, version=1.6.5, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.ceph.component=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-type=git, io.ceph.git.branch=devel, release=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.branch=undefined, io.buildah.version=1.29.0, io.spdk.build.ceph-release=20.2.0, io.spdk.build.makeflags=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.component=ubi9-container) 2026-02-18T03:42:43.260 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 bash[75020]: 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 podman[75020]: 2026-02-18 03:42:42.99793367 +0000 UTC m=+0.009758679 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 systemd[1]: Started Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.d, using rotation 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:42:43.261 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [gateway] 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): name = client.nvmeof.nvmeof.d 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:42:43.262 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): port = 5500 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:42:43.263 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:42:43.264 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:42:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): force_tls = False 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.266 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [discovery] 2026-02-18T03:42:43.267 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): addr = 10.20.193.177 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): port = 8009 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [ceph] 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): pool = mypool 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): id = nvmeof.nvmeof.d 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.268 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [mtls] 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [spdk] 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:42:43.269 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): transports = tcp 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): [monitor] 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:42:43.270 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:42:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.d 2026-02-18T03:42:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:42:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:42:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:42:43.271 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:42:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: pgmap v594: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.95k op/s 2026-02-18T03:42:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:43.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:43.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:43.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:43.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:43 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/381430595' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: pgmap v594: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.95k op/s 2026-02-18T03:42:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:43.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:43 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/381430595' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:43.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:42:43.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.177:5499 for group id 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.d group id=3 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:42:43.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:42:43.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:43 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:43] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='client.90988 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.d", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: Schedule restart daemon nvmeof.nvmeof.d 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='client.90988 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.d", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: Schedule restart daemon nvmeof.nvmeof.d 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: pgmap v595: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.59k op/s 2026-02-18T03:42:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1571957693' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3693755717' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: pgmap v595: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.59k op/s 2026-02-18T03:42:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1571957693' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3693755717' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:45.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:42:45.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:42:45.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: INFO: Setting log level to WARNING 2026-02-18T03:42:45.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:42:45.575 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.306981] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.307145] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.424275] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.450081] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.450090] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.450099] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.450100] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:42:45.576 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.574383] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:42:45.826 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:42:45.826 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO discovery.py:369 (78): discovery addr: 10.20.193.177 port: 8009 2026-02-18T03:42:45.827 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial177). 2026-02-18T03:42:45.828 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial177). 2026-02-18T03:42:45.828 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO state.py:2073 (78): Initialization is over (discovery-trial177). 2026-02-18T03:42:45.828 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:42:45.828 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.825668] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:42:45.828 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:45.825694] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:42:45.830 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:42:45.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mon.a calling monitor election 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mon.b calling monitor election 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mon.c calling monitor election 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mon.a calling monitor election 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: monmap epoch 3 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: min_mon_release 20 (tentacle) 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: election_strategy: 1 2026-02-18T03:42:45.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: fsmap 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: mgrmap e15: x(active, since 18m) 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:45.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:45 trial155 ceph-mon[87919]: NVMeoF Gateway 'client.nvmeof.nvmeof.d' is unavailable. 2026-02-18T03:42:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/973119924' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/825911843' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v585: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 3.59k op/s 2026-02-18T03:42:46.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/277012126' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v586: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 37 MiB/s wr, 3.09k op/s 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v587: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.09k op/s 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v588: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.30k op/s 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3369619302' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/4149843884' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/384958219' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v589: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.96k op/s 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v590: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.59k op/s 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:46.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v591: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3401821913' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/378846790' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v592: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 35 MiB/s wr, 3.08k op/s 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.100691 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3529103254' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4015443322' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4124823929' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3752001483' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.100697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:46.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v593: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.28k op/s 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v594: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.95k op/s 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/381430595' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.90988 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.d", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: Schedule restart daemon nvmeof.nvmeof.d 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: pgmap v595: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.59k op/s 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1571957693' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3693755717' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mon.b calling monitor election 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mon.c calling monitor election 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: monmap epoch 3 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: min_mon_release 20 (tentacle) 2026-02-18T03:42:46.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: election_strategy: 1 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: fsmap 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: mgrmap e15: x(active, since 18m) 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:46.027 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:45 trial034 ceph-mon[109579]: NVMeoF Gateway 'client.nvmeof.nvmeof.d' is unavailable. 2026-02-18T03:42:46.081 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:42:46.083 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO cephutils.py:308 (2): Registered nvmeof.d to service_map! 2026-02-18T03:42:46.083 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:42:46.083 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:42:46.083 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.084 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:42:46.085 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:45] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:42:46.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:42:46.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.086 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.087 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:42:46.088 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.088 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:42:46.088 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.088 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:42:46.088 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.093 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:42:46.094 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:42:46.094 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:42:46.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 18m) 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:42:46.124 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:46.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:42:46.125 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:45 trial086 ceph-mon[98535]: NVMeoF Gateway 'client.nvmeof.nvmeof.d' is unavailable. 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 3586, 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:42:46.174 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.175 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:42:46.176 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.177 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:42:46.178 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.179 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.180 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.181 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.182 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.183 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.184 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.187 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.188 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.189 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.190 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.191 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:42:46.192 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:42:46.197 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:42:46.197 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:42:46.198 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:42:46.277 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 174335, 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:42:46.278 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.279 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.280 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:42:46.281 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:42:46.282 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.283 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.284 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.285 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.286 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.287 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.288 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.289 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.290 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "num": 6 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:42:46.291 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "num": 81 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.292 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.293 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:42:46.293 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:42:46.294 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:42:46.294 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:42:46.295 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:42:46.340 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.175341] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.177:0/1536716410, rc 0 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.175410] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.177:0/1536716410 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.177:0/1536716410' 2026-02-18T03:42:46.341 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.191320] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.204318] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.204594] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.204608] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:46.342 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:46.379 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:42:46.379 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:42:46.379 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:42:46.379 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 332720, 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:42:46.380 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.381 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.382 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:42:46.383 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:42:46.384 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:42:46.385 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.386 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:42:46.387 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.388 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:42:46.389 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:42:46.390 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "num": 31 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:42:46.391 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:42:46.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:42:46.391 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:42:46.391 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:42:46.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.380511] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.177:0/1471446089, rc 0 2026-02-18T03:42:46.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.380561] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.177:0/1471446089 2026-02-18T03:42:46.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.177:0/1471446089' 2026-02-18T03:42:46.595 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.405831] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.411702] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.411721] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.567326] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.177:0/660699557, rc 0 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.567377] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.177:0/660699557 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.177:0/660699557' 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.589246] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:42:46.596 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.594412] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:42:46.597 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.594431] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:46.650 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:42:46.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:46.909 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.778062] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.177:0/730357739, rc 0 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.778131] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.177:0/730357739 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.177:0/730357739' 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.797086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.803169] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.803190] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:46.910 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/30167355' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: pgmap v596: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.10k op/s 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/895476456' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3646015412' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {auth=52,config=2,health=13,kv=33} crc {auth=2444664821,config=1466402343,health=1362555422,kv=4157930154}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {kv=91,logm=9} crc {kv=1048745561,logm=3594516055}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755552160}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2386545842}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=384135214}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1101103437}) 2026-02-18T03:42:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2854441355}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=338332250}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1749214164}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472197434}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2176552209}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3903503011}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2105299950}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236885050}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4213125082}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=851383714}) 2026-02-18T03:42:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=567368409}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112123615}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4016882478}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1399172338}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1525082687}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643621319}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168091994}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3553419444}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101003794}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2284497815}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3540481387}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2495434570}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449048126}) 2026-02-18T03:42:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2582404797}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=308806253}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2707224332}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1063058246}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1639028984}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4006014516}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3057279753}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3282842940}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2839565410}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3447325211}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112116736}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449701372}) 2026-02-18T03:42:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {logm=62,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=15} crc {logm=891008513,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3168723887}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3507024609}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=322318695}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=37,mon_config_key=63} crc {mgrstat=3039692676,mon_config_key=2499289247}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1474048650}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=56,monmap=5,nvmeofgw=39} crc {mon_config_key=871811359,monmap=1407976167,nvmeofgw=2038399869}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1531997159}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=56,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {nvmeofgw=87348387,osd_metadata=2727074769,osd_pg_creating=3942925033,osd_snap=3842414688,osdmap=752598519}) 2026-02-18T03:42:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:46 trial155 ceph-mon[87919]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=84} crc {osdmap=4107660341}) 2026-02-18T03:42:47.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/30167355' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:47.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: pgmap v596: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.10k op/s 2026-02-18T03:42:47.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/895476456' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:47.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3646015412' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {auth=52,config=2,health=13,kv=33} crc {auth=2444664821,config=1466402343,health=1362555422,kv=4157930154}) 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {kv=91,logm=9} crc {kv=1048745561,logm=3594516055}) 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755552160}) 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2386545842}) 2026-02-18T03:42:47.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=384135214}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1101103437}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2854441355}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=338332250}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1749214164}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472197434}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2176552209}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3903503011}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2105299950}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236885050}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4213125082}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=851383714}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=567368409}) 2026-02-18T03:42:47.023 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112123615}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4016882478}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1399172338}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1525082687}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643621319}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168091994}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3553419444}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101003794}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2284497815}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3540481387}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2495434570}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449048126}) 2026-02-18T03:42:47.024 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2582404797}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=308806253}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2707224332}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1063058246}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1639028984}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4006014516}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3057279753}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3282842940}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2839565410}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3447325211}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112116736}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449701372}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=62,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=15} crc {logm=891008513,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3168723887}) 2026-02-18T03:42:47.025 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3507024609}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=322318695}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=37,mon_config_key=63} crc {mgrstat=3039692676,mon_config_key=2499289247}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1474048650}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=56,monmap=5,nvmeofgw=39} crc {mon_config_key=871811359,monmap=1407976167,nvmeofgw=2038399869}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1531997159}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=56,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {nvmeofgw=87348387,osd_metadata=2727074769,osd_pg_creating=3942925033,osd_snap=3842414688,osdmap=752598519}) 2026-02-18T03:42:47.026 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=84} crc {osdmap=4107660341}) 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/30167355' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: pgmap v596: 33 pgs: 33 active+clean; 16 GiB data, 50 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.10k op/s 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/895476456' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.027 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3646015412' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {auth=52,config=2,health=13,kv=33} crc {auth=2444664821,config=1466402343,health=1362555422,kv=4157930154}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=91,logm=9} crc {kv=1048745561,logm=3594516055}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755552160}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2386545842}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=384135214}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1101103437}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2854441355}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=338332250}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1749214164}) 2026-02-18T03:42:47.028 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2472197434}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2176552209}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3903503011}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2105299950}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236885050}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4213125082}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=851383714}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=567368409}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112123615}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4016882478}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1399172338}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1525082687}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643621319}) 2026-02-18T03:42:47.029 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168091994}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3553419444}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101003794}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2284497815}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3540481387}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2495434570}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449048126}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2582404797}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=308806253}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2707224332}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1063058246}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1639028984}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4006014516}) 2026-02-18T03:42:47.030 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3057279753}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3282842940}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2839565410}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3447325211}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=112116736}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=449701372}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=62,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=15} crc {logm=891008513,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=3168723887}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3507024609}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=322318695}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=37,mon_config_key=63} crc {mgrstat=3039692676,mon_config_key=2499289247}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1474048650}) 2026-02-18T03:42:47.031 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=56,monmap=5,nvmeofgw=39} crc {mon_config_key=871811359,monmap=1407976167,nvmeofgw=2038399869}) 2026-02-18T03:42:47.032 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1531997159}) 2026-02-18T03:42:47.032 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=56,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {nvmeofgw=87348387,osd_metadata=2727074769,osd_pg_creating=3942925033,osd_snap=3842414688,osdmap=752598519}) 2026-02-18T03:42:47.032 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=84} crc {osdmap=4107660341}) 2026-02-18T03:42:47.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.945757] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.177:0/2190338564, rc 0 2026-02-18T03:42:47.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.945805] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.177:0/2190338564 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.177:0/2190338564' 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.967306] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:46] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.971866] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:46 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:46.971885] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.124037] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.177:0/950739825, rc 0 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.124086] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.177:0/950739825 2026-02-18T03:42:47.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.177:0/950739825' 2026-02-18T03:42:47.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.141169] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:42:47.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.152837] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:42:47.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.152860] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:47.625 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.625 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:47.625 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.301189] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.177:0/3693106063, rc 0 2026-02-18T03:42:47.625 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.301240] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.177:0/3693106063 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.177:0/3693106063' 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.323778] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.330875] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.330907] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.481007] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.177:0/300430396, rc 0 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.481057] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.177:0/300430396 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.177:0/300430396' 2026-02-18T03:42:47.626 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.501519] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.627 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:42:47.627 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.509933] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:42:47.627 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.509961] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:47.627 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.627 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:47.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.666225] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.177:0/4145781127, rc 0 2026-02-18T03:42:47.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.666276] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.177:0/4145781127 2026-02-18T03:42:47.890 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.177:0/4145781127' 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.687674] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.695184] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.695213] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.807928] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.177:0/1096504954, rc 0 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.807978] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.177:0/1096504954 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.177:0/1096504954' 2026-02-18T03:42:47.891 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.819120] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:47.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:42:47.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.823636] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:42:47.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.823656] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:47.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:47.892 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:42:47] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:42:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:42:48.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:42:48.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:42:48.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:42:48.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:35164 2026-02-18T03:42:48.154 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.919524] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.177:0/2617363861, rc 0 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.919582] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.177:0/2617363861 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.177:0/2617363861' 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.931065] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:47] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.936184] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:47 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:47.936204] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.155 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.035953] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.177:0/96037996, rc 0 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.036002] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.177:0/96037996 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.177:0/96037996' 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.048646] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.053572] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.053592] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.153520] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.177:0/2729770701, rc 0 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.153574] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.177:0/2729770701 2026-02-18T03:42:48.156 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.177:0/2729770701' 2026-02-18T03:42:48.463 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.164691] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.169183] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.169203] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.265032] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.177:0/2724798153, rc 0 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.265082] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.177:0/2724798153 2026-02-18T03:42:48.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.177:0/2724798153' 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.276307] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.280785] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.280805] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.384774] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.177:0/4017976815, rc 0 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.384824] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.177:0/4017976815 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.177:0/4017976815' 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.396444] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:42:48.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.400967] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:42:48.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.400987] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.501188] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.177:0/2461857946, rc 0 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.501239] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.177:0/2461857946 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.177:0/2461857946' 2026-02-18T03:42:48.725 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.513278] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.518416] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.518435] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.626263] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.177:0/2798069711, rc 0 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.626319] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.177:0/2798069711 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.177:0/2798069711' 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.640329] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.648555] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:42:48.726 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.648583] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:48.727 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:48.727 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:48.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:48 trial155 ceph-mon[87919]: pgmap v597: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:42:49.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.757505] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.177:0/2433537234, rc 0 2026-02-18T03:42:49.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.758319] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.177:0/2433537234 2026-02-18T03:42:49.001 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.177:0/2433537234' 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.771164] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.776078] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.776097] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.879922] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.177:0/3148554077, rc 0 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.879972] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.177:0/3148554077 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.177:0/3148554077' 2026-02-18T03:42:49.002 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.891929] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.896480] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:48.896500] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:48 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.003 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.000533] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.177:0/391703789, rc 0 2026-02-18T03:42:49.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:48 trial034 ceph-mon[109579]: pgmap v597: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:42:49.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:48 trial086 ceph-mon[98535]: pgmap v597: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.001328] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.177:0/391703789 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.177:0/391703789' 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.014196] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.018692] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.018710] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:49.254 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.118681] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.177:0/1507771476, rc 0 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.118731] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.177:0/1507771476 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.177:0/1507771476' 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.130619] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.135679] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.135700] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.239553] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.177:0/1048477102, rc 0 2026-02-18T03:42:49.255 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.239602] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.177:0/1048477102 2026-02-18T03:42:49.256 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.177:0/1048477102' 2026-02-18T03:42:49.256 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.252801] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.507 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:42:49.507 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.257862] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:42:49.507 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.257883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.361923] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.177:0/3649940131, rc 0 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.361976] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.177:0/3649940131 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.177:0/3649940131' 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.374163] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.378703] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.378723] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.508 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.492210] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.177:0/1027205869, rc 0 2026-02-18T03:42:49.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.492260] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.177:0/1027205869 2026-02-18T03:42:49.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.177:0/1027205869' 2026-02-18T03:42:49.509 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.506116] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.821 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.510678] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.510697] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.614723] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.177:0/4196019525, rc 0 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.614772] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.177:0/4196019525 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.177:0/4196019525' 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.626135] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:42:49.822 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.630717] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.630737] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.730855] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.177:0/3707399372, rc 0 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.730905] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.177:0/3707399372 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.177:0/3707399372' 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.743067] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.748006] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.748024] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:49.823 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.856062] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.177:0/2170153343, rc 0 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.856115] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.177:0/2170153343 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.177:0/2170153343' 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.869614] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.874392] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.874411] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.102 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.978580] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.177:0/3693535970, rc 0 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.978638] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.177:0/3693535970 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.177:0/3693535970' 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.992198] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:49] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.996762] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:49 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:49.996782] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.100723] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.177:0/2430993630, rc 0 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.100776] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.177:0/2430993630 2026-02-18T03:42:50.103 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.177:0/2430993630' 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.112898] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.117428] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.117448] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.217279] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.177:0/2156028202, rc 0 2026-02-18T03:42:50.415 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.217336] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.177:0/2156028202 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.177:0/2156028202' 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.229527] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.234204] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.234224] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.330439] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.177:0/1333037068, rc 0 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.330504] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.177:0/1333037068 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.177:0/1333037068' 2026-02-18T03:42:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.342069] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:42:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.346705] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:42:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.346724] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.682 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.446788] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.177:0/2049014803, rc 0 2026-02-18T03:42:50.682 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.446842] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.177:0/2049014803 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.177:0/2049014803' 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.460635] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.465414] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.465434] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.570330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.683 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:42:50.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.574677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:42:50.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.574700] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:50.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.684 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.681359] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.685943] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.685965] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.789920] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.794275] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.794300] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:50.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.902158] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:42:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.906489] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:42:50.965 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:50.906508] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:51.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:50 trial155 ceph-mon[87919]: pgmap v598: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:42:51.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:50 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.013152] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.017544] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.017563] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.121105] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.125555] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.125574] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.228713] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:42:51.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.233077] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:42:51.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.233097] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:51.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:50 trial034 ceph-mon[109579]: pgmap v598: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:42:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:50 trial086 ceph-mon[98535]: pgmap v598: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.35k op/s 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.337332] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.353530] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.353558] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.527 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.448499] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.452850] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.452870] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.528 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 121.60 1.3M 1.3M 0.0k 13.1M 12.6M 0.0k nvme12n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 118.10 1.3M 1.2M 0.0k 13.2M 11.8M 0.0k nvme16n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 116.20 1.2M 1.2M 0.0k 12.1M 12.3M 0.0k nvme20n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 117.60 1.2M 1.3M 0.0k 12.3M 12.6M 0.0k nvme24n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 119.80 1.3M 1.3M 0.0k 13.4M 12.9M 0.0k nvme28n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 125.30 1.3M 1.3M 0.0k 12.7M 12.7M 0.0k nvme32n3 2026-02-18T03:42:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 122.60 1.3M 1.3M 0.0k 13.2M 13.0M 0.0k nvme36n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 119.20 1.3M 1.3M 0.0k 12.6M 12.6M 0.0k nvme40n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 111.40 1.1M 1.3M 0.0k 10.8M 12.6M 0.0k nvme44n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 119.30 1.2M 1.2M 0.0k 12.1M 11.7M 0.0k nvme48n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 117.70 1.2M 1.3M 0.0k 12.4M 13.0M 0.0k nvme4n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 116.40 1.3M 1.3M 0.0k 13.0M 13.0M 0.0k nvme52n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 119.30 1.3M 1.3M 0.0k 13.5M 13.2M 0.0k nvme56n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 116.60 1.2M 1.3M 0.0k 12.1M 12.8M 0.0k nvme60n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 120.30 1.3M 1.3M 0.0k 13.0M 13.1M 0.0k nvme64n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 117.30 1.2M 1.4M 0.0k 11.9M 13.5M 0.0k nvme8n3 2026-02-18T03:42:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:42:51.780 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.559838] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.564210] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.564230] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.672664] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.677001] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.677021] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:51.781 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:51.782 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:51.782 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.779725] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:51.782 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:42:52.072 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.784176] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:42:52.072 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.784197] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:52.072 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.072 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.890016] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.894395] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.894415] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:51.997847] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:51] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.002344] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.002364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:52.073 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.074 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:51 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2069194295' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:51 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1687288603' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2069194295' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1687288603' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.327 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.106081] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.327 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.110463] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.110483] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.214449] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.218834] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.218852] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.328 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.326405] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.329 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:42:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2069194295' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1687288603' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:52.606 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.330790] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.330810] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.431145] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.435480] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.435500] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.607 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.533540] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.608 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:42:52.608 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.537888] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:42:52.608 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.537906] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:52.608 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.608 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.641931] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.646314] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.646335] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.863 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.749037] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.753720] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.753738] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.862119] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:52.864 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.866506] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.866526] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.975463] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:52] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:42:53.159 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.979868] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:52 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:52.979888] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.081951] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.086492] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.086511] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.160 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:52 trial155 ceph-mon[87919]: pgmap v599: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.99k op/s 2026-02-18T03:42:53.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:52 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2984937591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:53.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:52 trial034 ceph-mon[109579]: pgmap v599: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.99k op/s 2026-02-18T03:42:53.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:52 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2984937591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:52 trial086 ceph-mon[98535]: pgmap v599: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 29 MiB/s wr, 2.99k op/s 2026-02-18T03:42:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2984937591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:53.419 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.194764] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.199429] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.199449] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.312045] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.316535] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.316555] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:53.420 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.421 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.421 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.419014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.710 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:42:53.710 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.423493] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:42:53.710 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.423513] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:53.710 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.526229] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.530689] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.530708] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.634228] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.638636] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:42:53.711 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.638657] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:53.712 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.712 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.747131] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:42:53.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.751522] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.751541] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.859641] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.864325] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.864345] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:42:53.964 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:42:54.232 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.966270] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:53] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.970718] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:53 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:53.970738] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:54.042583] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.177 port 4420 *** 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.233 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.234 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.235 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.236 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.237 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.238 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.239 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial034 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial086 2026-02-18T03:42:54.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:42:54.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial177 differs from requested host trial155 2026-02-18T03:42:54.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:42:54.718 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:54] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.d). 2026-02-18T03:42:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:54 trial155 ceph-mon[87919]: pgmap v600: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 3.04k op/s 2026-02-18T03:42:55.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:54 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/879769767' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:55.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:54 trial034 ceph-mon[109579]: pgmap v600: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 3.04k op/s 2026-02-18T03:42:55.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/879769767' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:54 trial086 ceph-mon[98535]: pgmap v600: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 26 MiB/s wr, 3.04k op/s 2026-02-18T03:42:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/879769767' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:57.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:56 trial155 ceph-mon[87919]: pgmap v601: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 16 MiB/s wr, 2.23k op/s 2026-02-18T03:42:57.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:56 trial034 ceph-mon[109579]: pgmap v601: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 16 MiB/s wr, 2.23k op/s 2026-02-18T03:42:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:56 trial086 ceph-mon[98535]: pgmap v601: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 17 MiB/s rd, 16 MiB/s wr, 2.23k op/s 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:42:56] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:42:57.464 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.465 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.466 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:42:57.467 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.468 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: states { 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: grp_id: 4 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: state: OPTIMIZED 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: } 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: ], , client address: IPv4 10.20.193.177:60922 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:56.978858] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000196 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:56 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:56.994829] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000191 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.010798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000164 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.026801] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000167 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.042812] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000177 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.058805] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000171 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.074781] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000148 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.098833] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000198 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:42:57.469 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:42:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:57 trial155 ceph-mon[87919]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:42:58.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:57 trial155 ceph-mon[87919]: Cluster is now healthy 2026-02-18T03:42:58.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:57 trial034 ceph-mon[109579]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:42:58.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:57 trial034 ceph-mon[109579]: Cluster is now healthy 2026-02-18T03:42:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:57 trial086 ceph-mon[98535]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:42:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:57 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:42:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:58 trial155 ceph-mon[87919]: pgmap v602: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 13 MiB/s rd, 12 MiB/s wr, 1.86k op/s 2026-02-18T03:42:59.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:58 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2912874390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:59.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:58 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/4087818357' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:59.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:58 trial034 ceph-mon[109579]: pgmap v602: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 13 MiB/s rd, 12 MiB/s wr, 1.86k op/s 2026-02-18T03:42:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2912874390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:59.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/4087818357' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:58 trial086 ceph-mon[98535]: pgmap v602: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 13 MiB/s rd, 12 MiB/s wr, 1.86k op/s 2026-02-18T03:42:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2912874390' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:42:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4087818357' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:00.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:42:59 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1092237216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:00.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:42:59 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1092237216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:42:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1092237216' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:01.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:00 trial155 ceph-mon[87919]: pgmap v603: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 8.2 MiB/s rd, 7.7 MiB/s wr, 1.47k op/s 2026-02-18T03:43:01.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:00 trial034 ceph-mon[109579]: pgmap v603: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 8.2 MiB/s rd, 7.7 MiB/s wr, 1.47k op/s 2026-02-18T03:43:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:00 trial086 ceph-mon[98535]: pgmap v603: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 8.2 MiB/s rd, 7.7 MiB/s wr, 1.47k op/s 2026-02-18T03:43:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme12n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme16n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme20n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme24n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme28n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme32n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme36n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme40n3 2026-02-18T03:43:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme44n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme48n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme4n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme52n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme56n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme60n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme64n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2026-02-18T03:43:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:01.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:43:02.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4205890999' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4205890999' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:01 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/4205890999' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:03.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:02 trial034 ceph-mon[109579]: pgmap v604: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 830 op/s 2026-02-18T03:43:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:02 trial086 ceph-mon[98535]: pgmap v604: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 830 op/s 2026-02-18T03:43:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:02 trial155 ceph-mon[87919]: pgmap v604: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 830 op/s 2026-02-18T03:43:05.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:04 trial034 ceph-mon[109579]: pgmap v605: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 766 op/s 2026-02-18T03:43:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:04 trial086 ceph-mon[98535]: pgmap v605: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 766 op/s 2026-02-18T03:43:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:04 trial155 ceph-mon[87919]: pgmap v605: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 766 op/s 2026-02-18T03:43:06.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/4084044606' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:06.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2193361115' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4084044606' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2193361115' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:05 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/4084044606' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:05 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2193361115' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:07.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:06 trial034 ceph-mon[109579]: pgmap v606: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 5.4 MiB/s rd, 4.6 MiB/s wr, 716 op/s 2026-02-18T03:43:07.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:06 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/450778678' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:06 trial086 ceph-mon[98535]: pgmap v606: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 5.4 MiB/s rd, 4.6 MiB/s wr, 716 op/s 2026-02-18T03:43:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/450778678' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:06 trial155 ceph-mon[87919]: pgmap v606: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 5.4 MiB/s rd, 4.6 MiB/s wr, 716 op/s 2026-02-18T03:43:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:06 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/450778678' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:09.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:08 trial034 ceph-mon[109579]: pgmap v607: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 9.9 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2026-02-18T03:43:09.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/373674111' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:09.279 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:08 trial155 ceph-mon[87919]: pgmap v607: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 9.9 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2026-02-18T03:43:09.280 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:08 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/373674111' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:08 trial086 ceph-mon[98535]: pgmap v607: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 9.9 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2026-02-18T03:43:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/373674111' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:11.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:10 trial034 ceph-mon[109579]: pgmap v608: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 1.60k op/s 2026-02-18T03:43:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:10 trial086 ceph-mon[98535]: pgmap v608: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 1.60k op/s 2026-02-18T03:43:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:10 trial155 ceph-mon[87919]: pgmap v608: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 1.60k op/s 2026-02-18T03:43:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.1M 2.2M 0.0k 21.4M 22.0M 0.0k nvme12n3 2026-02-18T03:43:11.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.2M 2.0M 0.0k 22.1M 20.4M 0.0k nvme16n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.1M 2.0M 0.0k 20.8M 20.4M 0.0k nvme20n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.1M 2.2M 0.0k 21.0M 21.5M 0.0k nvme24n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.90 2.1M 2.1M 0.0k 20.8M 20.5M 0.0k nvme28n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.50 2.2M 2.1M 0.0k 21.6M 21.4M 0.0k nvme32n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.50 2.2M 2.1M 0.0k 21.8M 21.0M 0.0k nvme36n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.2M 2.1M 0.0k 21.6M 21.2M 0.0k nvme40n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.0M 2.1M 0.0k 20.2M 21.0M 0.0k nvme44n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.2M 2.0M 0.0k 21.6M 20.5M 0.0k nvme48n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.3M 2.1M 0.0k 22.9M 21.3M 0.0k nvme4n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.2M 2.1M 0.0k 22.3M 21.4M 0.0k nvme52n3 2026-02-18T03:43:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 2.3M 2.1M 0.0k 22.7M 20.5M 0.0k nvme56n3 2026-02-18T03:43:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.1M 2.1M 0.0k 21.1M 21.0M 0.0k nvme60n3 2026-02-18T03:43:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.90 2.3M 2.1M 0.0k 23.5M 20.7M 0.0k nvme64n3 2026-02-18T03:43:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.0M 2.1M 0.0k 20.4M 21.3M 0.0k nvme8n3 2026-02-18T03:43:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:12 trial034 ceph-mon[109579]: pgmap v609: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 19 MiB/s wr, 1.87k op/s 2026-02-18T03:43:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1877933961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:13.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/493655174' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:12 trial086 ceph-mon[98535]: pgmap v609: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 19 MiB/s wr, 1.87k op/s 2026-02-18T03:43:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1877933961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/493655174' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:12 trial155 ceph-mon[87919]: pgmap v609: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 20 MiB/s rd, 19 MiB/s wr, 1.87k op/s 2026-02-18T03:43:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:12 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1877933961' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:12 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/493655174' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:14.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:13 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2652522676' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2652522676' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:13 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/2652522676' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:15.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:14 trial034 ceph-mon[109579]: pgmap v610: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.80k op/s 2026-02-18T03:43:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:14 trial086 ceph-mon[98535]: pgmap v610: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.80k op/s 2026-02-18T03:43:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:14 trial155 ceph-mon[87919]: pgmap v610: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.80k op/s 2026-02-18T03:43:16.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1843645093' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1843645093' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:16 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1843645093' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:17.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:17 trial034 ceph-mon[109579]: pgmap v611: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 31 MiB/s wr, 3.03k op/s 2026-02-18T03:43:17.274 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:17 trial086 ceph-mon[98535]: pgmap v611: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 31 MiB/s wr, 3.03k op/s 2026-02-18T03:43:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:17 trial155 ceph-mon[87919]: pgmap v611: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 31 MiB/s wr, 3.03k op/s 2026-02-18T03:43:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:19 trial034 ceph-mon[109579]: pgmap v612: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.17k op/s 2026-02-18T03:43:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:19 trial086 ceph-mon[98535]: pgmap v612: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.17k op/s 2026-02-18T03:43:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:19 trial155 ceph-mon[87919]: pgmap v612: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.17k op/s 2026-02-18T03:43:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3852714431' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:20.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2961857643' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:20.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3852714431' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:20.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2961857643' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/3852714431' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:20 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2961857643' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:21 trial034 ceph-mon[109579]: pgmap v613: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.37k op/s 2026-02-18T03:43:21.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:21 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3040515696' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:21 trial086 ceph-mon[98535]: pgmap v613: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.37k op/s 2026-02-18T03:43:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3040515696' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:21 trial155 ceph-mon[87919]: pgmap v613: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.37k op/s 2026-02-18T03:43:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:21 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3040515696' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.1M 2.2M 0.0k 20.6M 21.5M 0.0k nvme12n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.0M 2.1M 0.0k 19.9M 21.1M 0.0k nvme16n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 2.2M 2.0M 0.0k 21.5M 20.3M 0.0k nvme20n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.2M 2.1M 0.0k 21.8M 21.0M 0.0k nvme24n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.1M 2.1M 0.0k 20.9M 20.9M 0.0k nvme28n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.70 2.0M 2.0M 0.0k 19.8M 19.9M 0.0k nvme32n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.0M 2.1M 0.0k 19.7M 20.7M 0.0k nvme36n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.1M 2.1M 0.0k 21.1M 21.0M 0.0k nvme40n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.1M 2.1M 0.0k 20.6M 21.2M 0.0k nvme44n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.0M 2.1M 0.0k 19.9M 21.0M 0.0k nvme48n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.0M 2.0M 0.0k 19.6M 19.6M 0.0k nvme4n3 2026-02-18T03:43:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.70 2.0M 2.0M 0.0k 19.7M 19.9M 0.0k nvme52n3 2026-02-18T03:43:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.0M 2.1M 0.0k 19.7M 21.4M 0.0k nvme56n3 2026-02-18T03:43:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.2M 2.0M 0.0k 22.1M 20.2M 0.0k nvme60n3 2026-02-18T03:43:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.0M 2.1M 0.0k 20.4M 20.8M 0.0k nvme64n3 2026-02-18T03:43:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 2.1M 2.0M 0.0k 21.3M 20.3M 0.0k nvme8n3 2026-02-18T03:43:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:23 trial034 ceph-mon[109579]: pgmap v614: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.02k op/s 2026-02-18T03:43:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/69804836' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:23 trial086 ceph-mon[98535]: pgmap v614: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.02k op/s 2026-02-18T03:43:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/69804836' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:23 trial155 ceph-mon[87919]: pgmap v614: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.02k op/s 2026-02-18T03:43:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:23 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/69804836' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:25.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:25 trial034 ceph-mon[109579]: pgmap v615: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.65k op/s 2026-02-18T03:43:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:25 trial086 ceph-mon[98535]: pgmap v615: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.65k op/s 2026-02-18T03:43:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:25 trial155 ceph-mon[87919]: pgmap v615: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.65k op/s 2026-02-18T03:43:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:27 trial034 ceph-mon[109579]: pgmap v616: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.14k op/s 2026-02-18T03:43:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2608286600' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3820893130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:27 trial086 ceph-mon[98535]: pgmap v616: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.14k op/s 2026-02-18T03:43:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2608286600' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3820893130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:27 trial155 ceph-mon[87919]: pgmap v616: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.14k op/s 2026-02-18T03:43:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:27 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2608286600' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:27 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3820893130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:28 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/133413689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:28 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/133413689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:28.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:28 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/133413689' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:29 trial086 ceph-mon[98535]: pgmap v617: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:43:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:29 trial155 ceph-mon[87919]: pgmap v617: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:43:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:29 trial034 ceph-mon[109579]: pgmap v617: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:43:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1177496900' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:30 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1177496900' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1177496900' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:31 trial086 ceph-mon[98535]: pgmap v618: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:43:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:31 trial155 ceph-mon[87919]: pgmap v618: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:43:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:31 trial034 ceph-mon[109579]: pgmap v618: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.34k op/s 2026-02-18T03:43:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 2.1M 2.0M 0.0k 20.7M 19.6M 0.0k nvme12n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.80 1.8M 2.1M 0.0k 18.2M 21.0M 0.0k nvme16n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 209.90 2.1M 2.0M 0.0k 21.4M 20.2M 0.0k nvme20n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.1M 2.0M 0.0k 20.9M 20.1M 0.0k nvme24n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.70 2.1M 2.0M 0.0k 20.7M 20.4M 0.0k nvme28n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 1.9M 2.0M 0.0k 19.5M 19.6M 0.0k nvme32n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.0M 2.1M 0.0k 20.1M 20.8M 0.0k nvme36n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.1M 2.0M 0.0k 20.5M 20.4M 0.0k nvme40n3 2026-02-18T03:43:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.90 2.0M 2.0M 0.0k 20.2M 19.8M 0.0k nvme44n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 210.90 2.1M 2.0M 0.0k 21.2M 19.8M 0.0k nvme48n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.1M 2.0M 0.0k 20.9M 19.9M 0.0k nvme4n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.2M 2.1M 0.0k 22.0M 21.0M 0.0k nvme52n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.1M 2.0M 0.0k 21.2M 20.4M 0.0k nvme56n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 1.9M 2.0M 0.0k 18.6M 20.3M 0.0k nvme60n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 2.0M 2.0M 0.0k 20.4M 20.5M 0.0k nvme64n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 1.9M 2.0M 0.0k 19.0M 19.9M 0.0k nvme8n3 2026-02-18T03:43:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:33 trial086 ceph-mon[98535]: pgmap v619: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.01k op/s 2026-02-18T03:43:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:33 trial155 ceph-mon[87919]: pgmap v619: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.01k op/s 2026-02-18T03:43:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:33 trial034 ceph-mon[109579]: pgmap v619: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.01k op/s 2026-02-18T03:43:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2595326089' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:34.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/759075268' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:34.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2595326089' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:34.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:34 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/759075268' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:34.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2595326089' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/759075268' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:35 trial086 ceph-mon[98535]: pgmap v620: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:43:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:35 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3433562288' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:35 trial155 ceph-mon[87919]: pgmap v620: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:43:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:35 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3433562288' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:35 trial034 ceph-mon[109579]: pgmap v620: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.66k op/s 2026-02-18T03:43:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:35 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3433562288' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:37 trial086 ceph-mon[98535]: pgmap v621: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1011402984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:37 trial155 ceph-mon[87919]: pgmap v621: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:37 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/1011402984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:37 trial034 ceph-mon[109579]: pgmap v621: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1011402984' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:39.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:39 trial034 ceph-mon[109579]: pgmap v622: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:39 trial086 ceph-mon[98535]: pgmap v622: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:39 trial155 ceph-mon[87919]: pgmap v622: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:41 trial086 ceph-mon[98535]: pgmap v623: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.37k op/s 2026-02-18T03:43:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2247615313' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3467314330' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:41 trial155 ceph-mon[87919]: pgmap v623: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.37k op/s 2026-02-18T03:43:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2247615313' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:41 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/3467314330' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:41 trial034 ceph-mon[109579]: pgmap v623: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.37k op/s 2026-02-18T03:43:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2247615313' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3467314330' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:41.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 1.9M 2.1M 0.0k 18.6M 20.8M 0.0k nvme12n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.80 1.9M 2.0M 0.0k 18.8M 19.9M 0.0k nvme16n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 1.9M 2.0M 0.0k 19.1M 19.9M 0.0k nvme20n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.0M 2.0M 0.0k 20.2M 20.0M 0.0k nvme24n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.0M 2.0M 0.0k 19.8M 19.6M 0.0k nvme28n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 1.8M 2.0M 0.0k 18.1M 19.8M 0.0k nvme32n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 210.30 2.1M 2.0M 0.0k 21.4M 20.2M 0.0k nvme36n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 1.9M 2.1M 0.0k 18.8M 20.5M 0.0k nvme40n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.40 2.1M 1.9M 0.0k 21.0M 19.2M 0.0k nvme44n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 214.60 2.2M 2.0M 0.0k 21.6M 19.8M 0.0k nvme48n3 2026-02-18T03:43:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 1.9M 1.9M 0.0k 18.9M 19.0M 0.0k nvme4n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 1.9M 2.1M 0.0k 19.1M 20.6M 0.0k nvme52n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.0M 1.9M 0.0k 19.6M 19.5M 0.0k nvme56n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.0M 2.0M 0.0k 19.5M 20.1M 0.0k nvme60n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 1.9M 2.0M 0.0k 19.2M 19.6M 0.0k nvme64n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.0M 2.0M 0.0k 19.6M 20.5M 0.0k nvme8n3 2026-02-18T03:43:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1202280145' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:42 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/1202280145' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:42 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1202280145' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:43 trial086 ceph-mon[98535]: pgmap v624: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.04k op/s 2026-02-18T03:43:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:43 trial155 ceph-mon[87919]: pgmap v624: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.04k op/s 2026-02-18T03:43:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:43 trial034 ceph-mon[109579]: pgmap v624: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.04k op/s 2026-02-18T03:43:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:43:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/775271605' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:43:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:43:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:43:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:43:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:43:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/775271605' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:43:44.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:43:44.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:43:44.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:44 trial155 ceph-mon[87919]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:43:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:43:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/775271605' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:43:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:43:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:43:44.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:43:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:45 trial086 ceph-mon[98535]: pgmap v625: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.69k op/s 2026-02-18T03:43:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:45 trial155 ceph-mon[87919]: pgmap v625: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.69k op/s 2026-02-18T03:43:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:45 trial034 ceph-mon[109579]: pgmap v625: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.69k op/s 2026-02-18T03:43:46.651 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:43:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:47 trial086 ceph-mon[98535]: pgmap v626: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:47 trial155 ceph-mon[87919]: pgmap v626: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:47 trial034 ceph-mon[109579]: pgmap v626: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2791719966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2629458466' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/2791719966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:48 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2629458466' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:48.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2791719966' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2629458466' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:49 trial086 ceph-mon[98535]: pgmap v627: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3946007377' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:49 trial155 ceph-mon[87919]: pgmap v627: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:49 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/3946007377' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:49 trial034 ceph-mon[109579]: pgmap v627: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 3.17k op/s 2026-02-18T03:43:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:49 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3946007377' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:51 trial086 ceph-mon[98535]: pgmap v628: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:43:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/807785185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:51 trial155 ceph-mon[87919]: pgmap v628: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:43:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:51 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/807785185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:51 trial034 ceph-mon[109579]: pgmap v628: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.38k op/s 2026-02-18T03:43:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/807785185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 1.9M 1.9M 0.0k 19.3M 18.7M 0.0k nvme12n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.00 2.0M 1.9M 0.0k 20.0M 19.0M 0.0k nvme16n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 1.9M 1.9M 0.0k 18.6M 19.0M 0.0k nvme20n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.1M 1.9M 0.0k 20.5M 19.3M 0.0k nvme24n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 1.9M 1.9M 0.0k 19.2M 19.4M 0.0k nvme28n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 1.9M 2.0M 0.0k 18.9M 19.9M 0.0k nvme32n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 1.9M 2.0M 0.0k 19.1M 19.7M 0.0k nvme36n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 1.9M 1.9M 0.0k 19.3M 19.0M 0.0k nvme40n3 2026-02-18T03:43:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 1.8M 2.0M 0.0k 18.5M 19.6M 0.0k nvme44n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.30 1.8M 1.9M 0.0k 18.1M 19.4M 0.0k nvme48n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 1.9M 2.0M 0.0k 18.7M 19.9M 0.0k nvme4n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 1.9M 1.9M 0.0k 19.1M 19.2M 0.0k nvme52n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 2.1M 1.9M 0.0k 20.6M 18.9M 0.0k nvme56n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 1.9M 1.9M 0.0k 19.0M 18.9M 0.0k nvme60n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 2.0M 2.0M 0.0k 20.2M 19.9M 0.0k nvme64n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 2.0M 1.9M 0.0k 19.9M 19.2M 0.0k nvme8n3 2026-02-18T03:43:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:43:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:53 trial086 ceph-mon[98535]: pgmap v629: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.05k op/s 2026-02-18T03:43:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:53 trial155 ceph-mon[87919]: pgmap v629: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.05k op/s 2026-02-18T03:43:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:53 trial034 ceph-mon[109579]: pgmap v629: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.05k op/s 2026-02-18T03:43:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-mon[98535]: pgmap v630: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.68k op/s 2026-02-18T03:43:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1457131540' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2167405334' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:55 trial155 ceph-mon[87919]: pgmap v630: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.68k op/s 2026-02-18T03:43:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/1457131540' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:55 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/2167405334' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:55 trial034 ceph-mon[109579]: pgmap v630: 33 pgs: 33 active+clean; 16 GiB data, 51 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.68k op/s 2026-02-18T03:43:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1457131540' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2167405334' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:56.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:43:56.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:43:56.070 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:43:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/849725795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:56 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/849725795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:56 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/849725795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:57 trial086 ceph-mon[98535]: pgmap v631: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:57 trial155 ceph-mon[87919]: pgmap v631: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:57 trial034 ceph-mon[109579]: pgmap v631: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3323699563' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:58 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3323699563' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3323699563' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:43:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:43:59 trial086 ceph-mon[98535]: pgmap v632: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:43:59 trial155 ceph-mon[87919]: pgmap v632: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:43:59 trial034 ceph-mon[109579]: pgmap v632: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.15k op/s 2026-02-18T03:43:59.543 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:43:59.543 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:43:59.543 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 8min ago 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:43:59.573 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 376.2M (peak: 379.9M) 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 32min 32.277s 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:43:59.574 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 4 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:43:59.575 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:42:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:35164 2026-02-18T03:43:59.577 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:43:59.606 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 4min 7s ago 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 349.7M (peak: 352.5M) 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 16min 17.189s 2026-02-18T03:43:59.607 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:43:59.608 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.079935] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000145 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.103929] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000136 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.119941] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000146 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.135957] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000165 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.151975] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000175 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.167927] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000131 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:40:10 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:40:10.183926] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000133 seconds 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:43:59.609 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:43:55 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:43:55] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:43:59.610 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:34:10 UTC; 9min ago 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76636 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout: Process: 76637 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.643 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 76711 (conmon) 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 372.6M (peak: 376.7M) 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 39min 18.488s 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76713 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76715 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─76732 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─77099 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: │ └─77104 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.644 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout: └─76711 /usr/bin/conmon --api-version 1 -c ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -u ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata -p /run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: states { 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: grp_id: 4 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: state: INACCESSIBLE 2026-02-18T03:43:59.645 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: } 2026-02-18T03:43:59.646 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:40:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: ], , client address: IPv4 10.20.193.155:38580 2026-02-18T03:43:59.647 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:43:59.676 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 1min 16s ago 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 341.1M (peak: 343.7M) 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 5min 8.327s 2026-02-18T03:43:59.677 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:43:59.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.058805] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000171 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.074781] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000148 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.098833] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000198 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:43:59.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:43:59.681 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:43:59.905 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:43:59.905 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 6m ago 18m trial034=x;count:1 2026-02-18T03:43:59.906 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 9m ago 19m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:43:59.906 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 9m ago 17m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:43:59.906 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 9m ago 17m trial155 2026-02-18T03:43:59.915 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:44:00.099 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:44:00.099 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (8m) 6m ago 8m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:44:00.099 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (4m) 4m ago 8m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:44:00.099 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (9m) 9m ago 13m 54.5M - 1.6.5 99a57256b38c ffa6e201cd5e 2026-02-18T03:44:00.099 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (77s) 76s ago 8m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:44:00.108 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:44:00.334 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:44:00.344 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 74s) [leader: a] 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 19m) 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 17m), 8 in (since 17m) 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: usage: 52 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: client: 31 MiB/s rd, 31 MiB/s wr, 1.68k op/s rd, 1.68k op/s wr 2026-02-18T03:44:00.562 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:44:00.571 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:44:00.804 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:44:00.804 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 200, 2026-02-18T03:44:00.804 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 126, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:44:00.805 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:44:00.806 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:44:00.814 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:44:00.872 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.873 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.874 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.875 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.876 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.877 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.878 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:44:00.879 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:44:00.926 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:00.928 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:44:00.972 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:00.974 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:44:01.018 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.019 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:44:01.063 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.064 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:44:01.108 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.109 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:44:01.153 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.154 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:44:01.199 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.200 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:44:01.244 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.245 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:44:01.289 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.290 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:44:01.335 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.336 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:44:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: from='client.94549 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: pgmap v633: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.36k op/s 2026-02-18T03:44:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: from='client.117618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2803642934' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:44:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/135922851' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:44:01.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3671551932' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:44:01.381 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.382 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:44:01.427 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.428 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:44:01.472 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.473 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:44:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: from='client.94549 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: pgmap v633: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.36k op/s 2026-02-18T03:44:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: from='client.117618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/2803642934' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:44:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/135922851' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:44:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:01 trial155 ceph-mon[87919]: from='client.? 10.20.193.177:0/3671551932' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:44:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: from='client.94549 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: pgmap v633: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.36k op/s 2026-02-18T03:44:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: from='client.117618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:44:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2803642934' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:44:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/135922851' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:44:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3671551932' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:44:01.558 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.559 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:44:01.603 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.605 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:44:01.649 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.650 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:44:01.695 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.695 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:44:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:01.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 212.30 2.1M 1.9M 0.0k 20.5M 18.5M 0.0k nvme12n3 2026-02-18T03:44:01.738 INFO:tasks.workunit.client.0.trial014.stdout: 188.80 1.7M 1.8M 0.0k 16.6M 17.9M 0.0k nvme16n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.50 1.8M 2.0M 0.0k 18.2M 19.5M 0.0k nvme20n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 1.9M 2.0M 0.0k 18.9M 19.6M 0.0k nvme24n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 1.9M 1.8M 0.0k 19.4M 18.5M 0.0k nvme28n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 1.8M 1.8M 0.0k 17.8M 17.6M 0.0k nvme32n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 1.8M 1.8M 0.0k 18.1M 17.7M 0.0k nvme36n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.20 1.9M 1.9M 0.0k 18.7M 18.6M 0.0k nvme40n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 2.0M 1.9M 0.0k 19.5M 19.5M 0.0k nvme44n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 1.9M 1.8M 0.0k 19.1M 18.3M 0.0k nvme48n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 1.9M 1.9M 0.0k 18.5M 18.7M 0.0k nvme4n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.0M 2.0M 0.0k 19.6M 19.6M 0.0k nvme52n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 1.9M 1.9M 0.0k 18.7M 18.6M 0.0k nvme56n3 2026-02-18T03:44:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 1.9M 1.8M 0.0k 18.7M 18.4M 0.0k nvme60n3 2026-02-18T03:44:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 1.8M 2.0M 0.0k 18.0M 20.0M 0.0k nvme64n3 2026-02-18T03:44:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 1.9M 1.9M 0.0k 18.8M 18.6M 0.0k nvme8n3 2026-02-18T03:44:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:01.741 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.741 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:44:01.825 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.826 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:44:01.870 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.871 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:44:01.915 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.916 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:44:01.961 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:01.963 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:44:02.008 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.009 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:44:02.053 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.054 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:44:02.098 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.100 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:44:02.144 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.145 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:44:02.190 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.191 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:44:02.236 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.236 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:44:02.280 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.280 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:44:02.324 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.324 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:44:02.369 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.369 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:44:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/42803888' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1543880405' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.414 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.414 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:44:02.458 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.460 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:44:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.34:0/42803888' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:02 trial155 ceph-mon[87919]: from='client.? 10.20.193.155:0/1543880405' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.505 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.506 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:44:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/42803888' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1543880405' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:02.552 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.552 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:44:02.597 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.598 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:44:02.643 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.643 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:44:02.688 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.689 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:44:02.733 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.734 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:44:02.779 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.780 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:44:02.824 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.825 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:44:02.871 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.871 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:44:02.915 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.916 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:44:02.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:02.964 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:44:03.009 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.010 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:44:03.056 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.056 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:44:03.101 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.102 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:44:03.146 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.147 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:44:03.192 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.193 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:44:03.237 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.238 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:44:03.321 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.322 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:44:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:03 trial086 ceph-mon[98535]: pgmap v634: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 3.00k op/s 2026-02-18T03:44:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/305963592' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:03.408 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.409 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:44:03.455 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.456 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:44:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:03 trial155 ceph-mon[87919]: pgmap v634: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 3.00k op/s 2026-02-18T03:44:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:03 trial155 ceph-mon[87919]: from='client.? 10.20.193.86:0/305963592' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:03.501 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.502 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:44:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:03 trial034 ceph-mon[109579]: pgmap v634: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 3.00k op/s 2026-02-18T03:44:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:03 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/305963592' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:03.547 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.548 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:44:03.593 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.594 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:44:03.639 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.640 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:44:03.685 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.685 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:44:03.730 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.731 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:44:03.776 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.776 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:44:03.860 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.861 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:44:03.906 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.908 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:44:03.951 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.952 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:44:03.996 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:44:03.996 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:44:03.997 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.c 2026-02-18T03:44:03.997 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon rm nvmeof.nvmeof.c 2026-02-18T03:44:03.997 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:44:03.997 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:44:03.997 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:44:04.257 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":78,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:44:04.269 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:44:04.269 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:44:04.269 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:44:04.269 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:44:04.348 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:44:04.348 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:04.348 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:04.348 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:44:04.348 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 81760, 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 78, 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:44:04.349 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.350 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.351 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:44:04.352 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.353 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.354 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.355 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.356 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.357 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.358 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.359 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:44:04.360 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: "num": 16 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.361 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.362 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.362 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:44:04.362 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:44:04.363 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:44:04.363 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:44:04.364 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 252500, 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:44:04.441 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 78, 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.442 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:44:04.443 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.444 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:44:04.445 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.446 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.447 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:44:04.448 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:04.449 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.450 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.451 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.452 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.453 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "num": 6 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:44:04.454 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "num": 82 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.455 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.456 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:44:04.456 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:44:04.457 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:44:04.457 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:44:04.458 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 44, 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 410879, 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:44:04.537 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 78, 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.538 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:44:04.539 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.540 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:44:04.541 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:04.542 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.543 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.544 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.545 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:44:04.546 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:04.547 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.548 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.549 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:44:04.550 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "num": 49 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:04.551 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:04.552 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:44:04.552 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:44:04.553 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:44:04.554 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['c'] 2026-02-18T03:44:04.554 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:44:04.554 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.c 2026-02-18T03:44:04.554 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.c 2026-02-18T03:44:04.554 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:44:04.554 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:44:04.722 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:04 trial155 systemd[1]: Stopping Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:44:04.722 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[87915]: 2026-02-18T03:44:04.669+0000 7eff961b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:44:04.722 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[87915]: 2026-02-18T03:44:04.669+0000 7eff961b8640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:44:04.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:04 trial155 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:44:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:04] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:44:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:04] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:44:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:04] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.155:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.155:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:44:04.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:04] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:44:04.824 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service' 2026-02-18T03:44:04.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:44:04.863 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:44:04.863 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:44:04.863 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:44:05.110 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":79,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:44:08.122 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:07 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:07] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial155) 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:44:08.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[76711]: [18-Feb-2026 03:44:08] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:44:08.377 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":82,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 podman[91066]: 2026-02-18 03:44:08.222130986 +0000 UTC m=+3.735974838 container died ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.spdk.build.target-arch=x86-64-v2, io.ceph.version=1.6.5, io.spdk.version=25.09, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.pkgdep-args=--rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.buildah.version=1.29.0, version=1.6.5, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.ceph.nvmeof=, io.spdk.git.branch=undefined, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, io.spdk.build.makeflags=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, release=, build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9, vcs-type=git, maintainer=Ceph Developers , distribution-scope=public, vendor=Red Hat, Inc.) 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 podman[91066]: 2026-02-18 03:44:08.23972735 +0000 UTC m=+3.753571212 container remove ffa6e201cd5ea94260abbbc33c83bf8dd5563ae455158377465cacc96d2982ee (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, vendor=Red Hat, Inc., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, io.ceph.component=ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.version=9.0-30.el9, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, io.spdk.build.makeflags=, url=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.ceph.nvmeof=, io.buildah.version=1.29.0, io.spdk.build.pkgdep-args=--rbd, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, version=1.6.5, io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.version=25.09, distribution-scope=public, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.branch=undefined, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 bash[91066]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:44:08.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:08 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 39min 48.802s CPU time, 376.7M memory peak. 2026-02-18T03:44:11.390 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:44:11.642 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":86,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:44:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 210.10 2.0M 1.9M 0.0k 19.7M 18.5M 0.0k nvme12n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 209.70 1.9M 1.9M 0.0k 19.4M 18.5M 0.0k nvme16n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 1.8M 1.8M 0.0k 17.6M 18.4M 0.0k nvme20n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 1.9M 1.8M 0.0k 19.1M 18.2M 0.0k nvme24n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 211.40 2.0M 1.8M 0.0k 19.9M 18.4M 0.0k nvme28n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 210.00 3.1M 3.2M 0.0k 31.5M 31.6M 0.0k nvme32n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 210.30 2.0M 1.8M 0.0k 19.8M 17.7M 0.0k nvme36n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 1.9M 1.8M 0.0k 18.8M 18.0M 0.0k nvme40n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 207.30 1.9M 1.8M 0.0k 19.2M 18.1M 0.0k nvme44n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 213.10 2.1M 2.0M 0.0k 20.7M 20.2M 0.0k nvme48n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 1.7M 1.8M 0.0k 17.3M 18.3M 0.0k nvme4n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.90 1.8M 1.9M 0.0k 18.1M 19.0M 0.0k nvme52n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.50 1.8M 1.8M 0.0k 18.0M 18.4M 0.0k nvme56n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 1.9M 1.8M 0.0k 18.7M 18.4M 0.0k nvme60n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 1.7M 2.0M 0.0k 17.5M 19.9M 0.0k nvme64n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 1.9M 1.8M 0.0k 19.1M 18.0M 0.0k nvme8n3 2026-02-18T03:44:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:14.655 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:44:19.311 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":48,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:44:19.324 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:44:19.324 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:44:19.324 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:44:19.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.121444] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.121521] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.127571] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.127619] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.128019] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.128043] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.134001] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.134031] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.142921] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.142949] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.143405] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.143423] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.144487] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.144506] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.147731] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.147758] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.148206] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.148226] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.150684] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.150713] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151089] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151110] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151535] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151555] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151876] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.151891] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.152227] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.152239] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.152598] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.152612] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.152984] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.153003] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.153304] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.153323] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.153734] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.153750] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.154070] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.154083] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.154513] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.154527] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.165782] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.165814] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.166177] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.166201] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.168794] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.168820] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169185] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169200] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169514] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169530] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169961] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.169982] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.170322] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.170334] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.170697] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.170715] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171065] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171088] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171422] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171438] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171737] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.171757] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172153] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172173] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172452] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172471] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172842] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.172859] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.173235] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.173251] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.173631] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.173650] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.174330] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.174347] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.174714] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.174732] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.175205] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.175223] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.175609] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.175633] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176032] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176048] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176442] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176455] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176838] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.176866] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.177300] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.177323] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.177764] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.177782] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178193] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178212] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178605] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178624] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178962] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.178978] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.179395] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.179413] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.179863] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.179882] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180179] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180195] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180524] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180542] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180836] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.180860] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.181119] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.181138] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.181543] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.181557] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184020] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184044] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184329] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184346] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184708] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.184723] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185050] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185063] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.384 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185440] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185452] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185800] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185817] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186164] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186179] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186529] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186554] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186894] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:44:19.385 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186919] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 48, 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 96812, 2026-02-18T03:44:19.400 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.401 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:44:19.402 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.403 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:44:19.404 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.405 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:44:19.406 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:44:19.407 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:19.408 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.409 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.410 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.411 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:44:19.412 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: "num": 21 2026-02-18T03:44:19.413 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.414 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.414 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.414 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:44:19.414 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:44:19.415 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:44:19.415 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:44:19.416 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:44:19.494 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:44:19.494 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 48, 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 267552, 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 0, 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:19.495 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.496 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.497 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:44:19.498 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:44:19.499 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:44:19.500 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.501 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:44:19.502 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.503 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.504 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.505 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.506 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.507 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "num": 91 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:44:19.508 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:44:19.509 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:44:19.510 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:44:19.511 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:44:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 systemd[1]: Starting Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:44:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 podman[91538]: 2026-02-18 03:44:19.740002897 +0000 UTC m=+0.018253227 container create 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, architecture=x86_64, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , version=1.6.5, io.ceph.version=1.6.5, io.spdk.build.makeflags=, summary=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.buildah.version=1.29.0, com.redhat.component=ubi9-container, build-date=2026-02-11 09:53:49 UTC, io.spdk.version=25.09, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.ceph-release=20.2.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=undefined, distribution-scope=public, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, release=, maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.nvmeof=, vcs-type=git, name=ceph-nvmeof, org.centos.version=9.0-30.el9, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd, io.ceph.component=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/) 2026-02-18T03:44:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 podman[91538]: 2026-02-18 03:44:19.769524015 +0000 UTC m=+0.047774345 container init 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.ceph.nvmeof=, architecture=x86_64, io.spdk.build.ceph-release=20.2.0, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, summary=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.branch=devel, io.openshift.wants=ceph,rbd, vcs-type=git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.ceph.version=1.6.5, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, vendor=Red Hat, Inc., release=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.branch=undefined, io.spdk.version=25.09, maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, distribution-scope=public, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/) 2026-02-18T03:44:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 podman[91538]: 2026-02-18 03:44:19.771912402 +0000 UTC m=+0.050162722 container start 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.ceph.version=1.6.5, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.makeflags=, io.spdk.git.branch=undefined, url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.nvmeof=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.maintainer=Ceph Developers , build-date=2026-02-11 09:53:49 UTC, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.version=25.09, name=ceph-nvmeof, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, release=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, architecture=x86_64, io.spdk.build.target-arch=x86-64-v2, org.centos.version=9.0-30.el9, io.spdk.build.pkgdep-args=--rbd, vendor=Red Hat, Inc., io.ceph.summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:44:19.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 bash[91538]: 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:44:19.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 podman[91538]: 2026-02-18 03:44:19.731682801 +0000 UTC m=+0.009933131 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:44:19.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 systemd[1]: Started Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:44:20.099 INFO:teuthology.orchestra.run.trial155.stdout:Removed nvmeof.nvmeof.c from host 'trial155' 2026-02-18T03:44:20.111 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:44:20.111 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 79 secs before reviving 2026-02-18T03:44:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:44:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:44:20.278 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:44:20.279 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [gateway] 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): port = 5500 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:44:20.280 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:44:20.281 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:44:20.282 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:44:20.283 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): force_tls = False 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:44:20.284 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [discovery] 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): port = 8009 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [ceph] 2026-02-18T03:44:20.285 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): pool = mypool 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [mtls] 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [spdk] 2026-02-18T03:44:20.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): transports = tcp 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:44:20.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): [monitor] 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:19 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:19] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.155:5499 for group id 2026-02-18T03:44:20.288 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:44:20.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:20] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3981324039' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v636: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v637: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2992223796' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2552869493' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: Removing key for client.nvmeof.nvmeof.c 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1848490088' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v638: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.40k op/s 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2434236394' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3633967202' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v639: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 27 MiB/s wr, 3.08k op/s 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: Health check failed: 4 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v640: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.79k op/s 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v641: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 30 MiB/s wr, 3.28k op/s 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: pgmap v642: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.30k op/s 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:44:20.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 19m) 2026-02-18T03:44:20.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='' 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: osdmap e58: 8 total, 8 up, 8 in 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"}]': finished 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:44:20.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: nvmeof.nvmeof.c removed from nvmeof gateways dashboard config 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:20.378 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1209537584' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3475232418' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.379 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:20 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:44:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3981324039' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v636: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:44:20.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v637: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.16k op/s 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2992223796' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2552869493' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: Removing key for client.nvmeof.nvmeof.c 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1848490088' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v638: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.40k op/s 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2434236394' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3633967202' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v639: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 27 MiB/s wr, 3.08k op/s 2026-02-18T03:44:20.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: Health check failed: 4 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v640: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.79k op/s 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: mon.b calling monitor election 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v641: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 30 MiB/s wr, 3.28k op/s 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: pgmap v642: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.30k op/s 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: monmap epoch 3 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: min_mon_release 20 (tentacle) 2026-02-18T03:44:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: election_strategy: 1 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: fsmap 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: osdmap e57: 8 total, 8 up, 8 in 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: mgrmap e15: x(active, since 19m) 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='' 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:44:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: osdmap e58: 8 total, 8 up, 8 in 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.nvmeof.nvmeof.c"}]': finished 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-rm", "name": "nvmeof.mypool.mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]} : dispatch 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "profile rbd"]}]': finished 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: gateway address: 10.20.193.155 from map_addr=None spec.addr=None host_ip='10.20.193.155' 2026-02-18T03:44:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: discovery address: 10.20.193.155 from map_discovery_addr=None spec.discovery_addr=None host_ip='10.20.193.155' 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: Deploying daemon nvmeof.nvmeof.c on trial155 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: nvmeof.nvmeof.c removed from nvmeof gateways dashboard config 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: delete gateway: monitor command {'prefix': 'nvme-gw delete', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1209537584' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:44:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3475232418' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:20 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:44:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:44:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: pgmap v645: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.88k op/s 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: Checking pool "mypool" exists for service nvmeof.mypool.mygroup0 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: pgmap v645: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.88k op/s 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "nvme-gw delete", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:21.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:21 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 216.20 2.0M 2.0M 0.0k 19.5M 20.3M 0.0k nvme12n3 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 210.40 2.2M 2.4M 0.0k 21.7M 23.7M 0.0k nvme16n3 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 211.10 2.2M 2.4M 0.0k 22.3M 24.4M 0.0k nvme20n3 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 212.60 1.9M 1.9M 0.0k 19.5M 18.9M 0.0k nvme24n3 2026-02-18T03:44:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 1.8M 1.8M 0.0k 18.4M 17.7M 0.0k nvme28n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 214.10 3.4M 3.3M 0.0k 33.5M 33.0M 0.0k nvme32n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 211.70 2.4M 2.5M 0.0k 23.7M 25.1M 0.0k nvme36n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 217.50 2.8M 2.7M 0.0k 28.0M 26.8M 0.0k nvme40n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.30 1.9M 1.9M 0.0k 18.8M 19.3M 0.0k nvme44n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 211.80 3.3M 3.4M 0.0k 33.4M 34.0M 0.0k nvme48n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 212.90 1.8M 1.9M 0.0k 18.3M 19.1M 0.0k nvme4n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.50 1.9M 1.9M 0.0k 19.2M 18.7M 0.0k nvme52n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 1.8M 2.0M 0.0k 18.0M 19.8M 0.0k nvme56n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 218.40 1.9M 1.9M 0.0k 19.5M 19.3M 0.0k nvme60n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.40 1.9M 1.8M 0.0k 19.1M 18.3M 0.0k nvme64n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 222.00 2.1M 2.0M 0.0k 20.8M 20.0M 0.0k nvme8n3 2026-02-18T03:44:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:22.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:44:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:44:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: INFO: Setting log level to WARNING 2026-02-18T03:44:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:44:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.118774] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:44:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.119011] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:44:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:44:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:22.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:44:22.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:44:22.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.237130] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:44:22.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.273782] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:44:22.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.273794] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:44:22.496 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.273805] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.273808] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.390667] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:44:22.497 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO discovery.py:369 (78): discovery addr: 10.20.193.155 port: 8009 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.442201] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.442297] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial155). 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial155). 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO state.py:2073 (78): Initialization is over (discovery-trial155). 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:44:22.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.499 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: nvmeof daemon_check_post [(nvmeof.nvmeof.a), (nvmeof.nvmeof.b), (nvmeof.nvmeof.c), (nvmeof.nvmeof.d)] 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.a', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.b', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.c', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "mygroup0", "pool": "mypool"}]': finished 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.d", "group": "mygroup0", "pool": "mypool"} : dispatch 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"} : dispatch 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"} : dispatch 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"} : dispatch 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"} : dispatch 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:22.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:22 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:44:22.779 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.779 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.779 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.780 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.781 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:44:22.782 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.777772] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.155:0/3903160456, rc 0 2026-02-18T03:44:22.783 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.777871] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.155:0/3903160456 2026-02-18T03:44:23.132 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.155:0/3903160456' 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.811051] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.827007] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.828396] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.828430] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.984811] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.155:0/3219705541, rc 0 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:22.986053] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.155:0/3219705541 2026-02-18T03:44:23.133 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.155:0/3219705541' 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.001730] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.019307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.019369] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:23.134 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: pgmap v646: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.87k op/s 2026-02-18T03:44:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3729214838' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:44:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3662929500' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:23.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.184914] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.155:0/3545858080, rc 0 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.185040] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.155:0/3545858080 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.155:0/3545858080' 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.206184] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.216309] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.216368] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:23.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.417715] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.155:0/3749063811, rc 0 2026-02-18T03:44:23.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.417807] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.155:0/3749063811 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: create gateway: monitor command {'prefix': 'nvme-gw create', 'id': 'client.nvmeof.nvmeof.d', 'group': 'mygroup0', 'pool': 'mypool'} 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: Adding NVMeoF gateway 10.20.193.34:5500 to Dashboard 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: Adding NVMeoF gateway 10.20.193.86:5500 to Dashboard 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: Adding NVMeoF gateway 10.20.193.155:5500 to Dashboard 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: Adding NVMeoF gateway 10.20.193.177:5500 to Dashboard 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.a"}]: dispatch 2026-02-18T03:44:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.b"}]: dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.c"}]: dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "nvmeof.mypool.mygroup0", "group": "mygroup0", "daemon_name": "nvmeof.nvmeof.d"}]: dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: pgmap v646: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.87k op/s 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3729214838' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:44:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3662929500' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.155:0/3749063811' 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.464221] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.468884] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.468926] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.646362] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.155:0/2385276943, rc 0 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.646516] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.155:0/2385276943 2026-02-18T03:44:23.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.155:0/2385276943' 2026-02-18T03:44:23.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.662829] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:23.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:44:23.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.667551] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:44:23.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.667582] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.833671] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.155:0/814440928, rc 0 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.833772] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.155:0/814440928 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.155:0/814440928' 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.859066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:23] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.875457] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:44:24.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:23.875524] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:24.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.065833] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.155:0/3421842756, rc 0 2026-02-18T03:44:24.067 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.065924] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.155:0/3421842756 2026-02-18T03:44:24.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.155:0/3421842756' 2026-02-18T03:44:24.319 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.090568] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.095298] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.095364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.264628] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.155:0/2080739780, rc 0 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.272052] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.155:0/2080739780 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.155:0/2080739780' 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.297591] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:24.320 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:44:24.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.318359] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:44:24.321 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.318425] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:24.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:24.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:24 trial086 ceph-mon[98535]: pgmap v647: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.61k op/s 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.491328] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.155:0/3335385632, rc 0 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.491423] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.155:0/3335385632 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.155:0/3335385632' 2026-02-18T03:44:24.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.521612] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:24.679 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:44:24.679 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.536193] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:44:24.679 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.536251] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:24.679 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.679 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:24 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:44:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:24 trial034 ceph-mon[109579]: pgmap v647: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.61k op/s 2026-02-18T03:44:24.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.725972] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.155:0/509367722, rc 0 2026-02-18T03:44:24.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.727041] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.155:0/509367722 2026-02-18T03:44:24.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.155:0/509367722' 2026-02-18T03:44:24.943 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.752326] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.763274] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.763319] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:24.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.942289] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.155:0/1264316889, rc 0 2026-02-18T03:44:25.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.943048] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.155:0/1264316889 2026-02-18T03:44:25.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.155:0/1264316889' 2026-02-18T03:44:25.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.970098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:25.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:24] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.996010] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:24.996075] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.178699] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.155:0/3275104565, rc 0 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.179038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.155:0/3275104565 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.155:0/3275104565' 2026-02-18T03:44:25.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.195588] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.203881] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.203968] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.369106] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.155:0/3180017162, rc 0 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.370310] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.155:0/3180017162 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.155:0/3180017162' 2026-02-18T03:44:25.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.408497] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:25.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:44:25.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.421367] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:44:25.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.421468] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:25.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:25.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:25.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.614997] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.155:0/1649629869, rc 0 2026-02-18T03:44:25.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.616040] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.155:0/1649629869 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.155:0/1649629869' 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.637064] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.648011] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.648065] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:25.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.838110] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.155:0/3788071694, rc 0 2026-02-18T03:44:26.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.839028] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.155:0/3788071694 2026-02-18T03:44:26.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.155:0/3788071694' 2026-02-18T03:44:26.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.855067] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:44:26.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.861120] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:25.861162] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:25] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.007471] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.155:0/2606687140, rc 0 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.013042] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.155:0/2606687140 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.155:0/2606687140' 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.033047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.043315] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.043361] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:26.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:26.424 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.188744] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.155:0/1873769291, rc 0 2026-02-18T03:44:26.424 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.189025] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.155:0/1873769291 2026-02-18T03:44:26.424 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.155:0/1873769291' 2026-02-18T03:44:26.424 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.212059] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.217362] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.217402] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.423163] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.155:0/1518613914, rc 0 2026-02-18T03:44:26.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.423252] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.155:0/1518613914 2026-02-18T03:44:26.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:26 trial086 ceph-mon[98535]: pgmap v648: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.65k op/s 2026-02-18T03:44:26.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2033973174' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:26.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3495567468' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.155:0/1518613914' 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.450839] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.458022] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.458066] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:26.682 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:26.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:26.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.660643] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.155:0/1175544411, rc 0 2026-02-18T03:44:26.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.660732] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.155:0/1175544411 2026-02-18T03:44:26.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.155:0/1175544411' 2026-02-18T03:44:26.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.681259] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:26 trial034 ceph-mon[109579]: pgmap v648: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.65k op/s 2026-02-18T03:44:26.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2033973174' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:26.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3495567468' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:26.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.685954] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.686000] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.879359] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.155:0/1509800447, rc 0 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.880038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.155:0/1509800447 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.155:0/1509800447' 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.912337] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:26] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:44:26.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.930730] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:44:26.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:26.930789] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:27.351 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.124522] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.155:0/2559090186, rc 0 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.125042] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.155:0/2559090186 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.155:0/2559090186' 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.149632] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.160621] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.160674] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:27.352 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:27.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:27.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.322577] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.155:0/1250637776, rc 0 2026-02-18T03:44:27.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.323042] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.155:0/1250637776 2026-02-18T03:44:27.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.155:0/1250637776' 2026-02-18T03:44:27.353 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.350625] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:27.608 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/562413458' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/562413458' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.356763] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.356812] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.539269] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.155:0/518729439, rc 0 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.547044] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.155:0/518729439 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.155:0/518729439' 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.564393] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:44:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.590006] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:44:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.590066] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:44:27] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:44:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:44:28.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:44:28.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: OPTIMIZED 2026-02-18T03:44:28.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:47460 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.611186] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.001054 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.626375] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000259 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.642388] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000256 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.658388] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000264 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.674450] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000336 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.690343] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000228 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.706373] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000254 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.722449] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000325 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.738385] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000228 seconds 2026-02-18T03:44:28.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.754453] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000297 seconds 2026-02-18T03:44:28.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.770432] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000284 seconds 2026-02-18T03:44:28.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.794332] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000224 seconds 2026-02-18T03:44:28.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:27 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [2026-02-18 03:44:27.818482] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000323 seconds 2026-02-18T03:44:28.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.059 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.847301] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.155:0/88900155, rc 0 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.852033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.155:0/88900155 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.155:0/88900155' 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.877938] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:27] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.892947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:27.893018] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.060 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.058500] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.155:0/1154943560, rc 0 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.058845] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.155:0/1154943560 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.155:0/1154943560' 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.076905] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.088918] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:44:28.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.088985] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.250739] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.155:0/1879527542, rc 0 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.251047] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.155:0/1879527542 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.155:0/1879527542' 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.273539] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.287295] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.287349] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.463788] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.155:0/2069745909, rc 0 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.464055] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.155:0/2069745909 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.155:0/2069745909' 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.485098] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.490579] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.490621] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.668041] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.155:0/2042132124, rc 0 2026-02-18T03:44:28.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.668137] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.155:0/2042132124 2026-02-18T03:44:28.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:28 trial086 ceph-mon[98535]: pgmap v649: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 37 MiB/s wr, 3.22k op/s 2026-02-18T03:44:28.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.155:0/2042132124' 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.681319] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.697464] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.697538] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.876900] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.155:0/4211445455, rc 0 2026-02-18T03:44:28.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.877039] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.155:0/4211445455 2026-02-18T03:44:28.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.155:0/4211445455' 2026-02-18T03:44:28.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.894202] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:28.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:44:28.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.898743] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:44:28.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:28.898786] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:29.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:28 trial034 ceph-mon[109579]: pgmap v649: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 37 MiB/s wr, 3.22k op/s 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:28] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.039605] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.155:0/2878188046, rc 0 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.039871] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.155:0/2878188046 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.155:0/2878188046' 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.066050] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.081994] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.082056] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.304715] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.155:0/521506159, rc 0 2026-02-18T03:44:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.305047] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.155:0/521506159 2026-02-18T03:44:29.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.155:0/521506159' 2026-02-18T03:44:29.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.320628] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:29.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.330275] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.330332] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.520324] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.155:0/577877187, rc 0 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.521038] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.155:0/577877187 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.155:0/577877187' 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.539522] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:29.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:44:29.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.549025] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:44:29.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.549069] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:29.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:29.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.769067] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.784337] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.784404] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:29.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.969045] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:29] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.974367] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:29.974407] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:30.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.157204] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:44:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.178467] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:44:30.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.178554] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.346818] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.354796] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.354844] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.542059] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.554003] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:44:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.554060] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:30.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:30 trial086 ceph-mon[98535]: pgmap v650: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.42k op/s 2026-02-18T03:44:30.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:30.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.769044] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.776653] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.776701] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:30.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:31.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:30 trial034 ceph-mon[109579]: pgmap v650: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.42k op/s 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.975371] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:30] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.980192] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:30.980237] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:31.169 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.168579] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.179134] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.179177] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.353218] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:44:31.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.368068] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:44:31.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.368128] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 187.50 3.1M 3.1M 0.0k 31.1M 31.1M 0.0k nvme12n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 189.00 2.9M 3.2M 0.0k 28.5M 32.0M 0.0k nvme16n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 186.50 2.9M 3.3M 0.0k 28.9M 32.8M 0.0k nvme20n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.6M 2.6M 0.0k 26.4M 26.3M 0.0k nvme24n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.8M 3.0M 0.0k 28.3M 29.8M 0.0k nvme28n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.40 3.0M 2.9M 0.0k 30.3M 29.0M 0.0k nvme32n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 186.30 2.9M 3.2M 0.0k 28.7M 31.6M 0.0k nvme36n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 188.40 3.1M 3.0M 0.0k 31.2M 30.5M 0.0k nvme40n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 3.1M 3.0M 0.0k 30.8M 29.5M 0.0k nvme44n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 3.2M 2.9M 0.0k 32.0M 28.7M 0.0k nvme48n3 2026-02-18T03:44:31.737 INFO:tasks.workunit.client.0.trial014.stdout: 190.00 2.7M 2.9M 0.0k 27.0M 29.5M 0.0k nvme4n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 187.00 2.1M 2.1M 0.0k 20.8M 21.3M 0.0k nvme52n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 2.1M 1.9M 0.0k 21.0M 19.3M 0.0k nvme56n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 193.10 2.7M 2.6M 0.0k 26.9M 25.7M 0.0k nvme60n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 2.2M 2.0M 0.0k 22.4M 20.2M 0.0k nvme64n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 193.70 3.4M 3.2M 0.0k 33.9M 31.7M 0.0k nvme8n3 2026-02-18T03:44:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.565071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.578610] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.578675] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:31.803 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.802205] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:32.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.815006] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:31.815066] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.034073] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.040199] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.040303] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:32.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.239803] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.259328] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.259382] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:32.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.449042] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:32.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:44:32.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.459319] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:44:32.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.459381] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.667055] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.674789] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:44:32.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.674847] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:32.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:32 trial086 ceph-mon[98535]: pgmap v651: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.30k op/s 2026-02-18T03:44:33.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:32 trial034 ceph-mon[109579]: pgmap v651: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.30k op/s 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.887547] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:32] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.902010] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:32.902085] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:33.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:33.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.113086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:33.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:44:33.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.128600] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:44:33.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.128648] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:33.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:33.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.316371] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.332115] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.332175] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:33.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:33.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.528046] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:33.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:44:33.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.540739] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:44:33.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.540799] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:33.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:33.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3767298276' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3052288120' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:34.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3767298276' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:34.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3052288120' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:34.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.753050] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.760525] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.760562] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.984046] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:33] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.993117] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:33.993161] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:34.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:34.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.217335] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:34.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:44:34.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.237755] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:44:34.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.237831] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:34.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:34.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:34.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.435065] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:34.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:44:34.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.466031] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:44:34.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.466166] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.680499] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.685064] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:44:34.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.685134] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:35.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3992730064' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:35.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:34 trial034 ceph-mon[109579]: pgmap v652: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 4.06k op/s 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.886718] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:34] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.894757] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:34.894801] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:35.084 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.083066] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3992730064' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:35.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:34 trial086 ceph-mon[98535]: pgmap v652: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 4.06k op/s 2026-02-18T03:44:35.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:44:35.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.099021] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:44:35.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.099084] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:44:35.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.297299] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.302027] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.302062] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.495053] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.502685] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.502734] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.687064] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:44:35.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.705704] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:44:35.944 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.705771] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.931523] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:35] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.943343] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:44:35.945 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:35.943405] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:36.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:36.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:36.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.125060] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:36.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:44:36.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.130189] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:44:36.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.130231] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:44:36.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:44:36.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:44:36.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.335803] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:44:36.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:44:36.540 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.357997] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.358064] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:36.478272] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.155 port 4420 *** 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.541 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.542 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:44:36.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:36] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:44:37.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:36 trial034 ceph-mon[109579]: pgmap v653: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.62k op/s 2026-02-18T03:44:37.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:36 trial086 ceph-mon[98535]: pgmap v653: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.62k op/s 2026-02-18T03:44:38.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1504239070' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:44:37] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:44:38.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:54432 2026-02-18T03:44:38.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1504239070' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:39.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:38 trial034 ceph-mon[109579]: pgmap v654: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.56k op/s 2026-02-18T03:44:39.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:38 trial086 ceph-mon[98535]: pgmap v654: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.56k op/s 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:44:40] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: states { 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: grp_id: 3 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: state: OPTIMIZED 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: } 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: ], , client address: IPv4 10.20.193.155:34362 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.646655] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000247 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.662693] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000304 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.674928] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000347 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.690664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000287 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.706727] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000317 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.718844] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000304 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.730690] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000322 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.746717] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000332 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.762675] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000322 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.778705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000343 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.794719] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000331 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.810664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000283 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.826721] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000335 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.842646] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000267 seconds 2026-02-18T03:44:40.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.858687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000281 seconds 2026-02-18T03:44:41.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:40 trial034 ceph-mon[109579]: pgmap v655: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 49 MiB/s wr, 3.78k op/s 2026-02-18T03:44:41.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1897924039' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:41.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2204615542' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:41.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:40 trial086 ceph-mon[98535]: pgmap v655: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 49 MiB/s wr, 3.78k op/s 2026-02-18T03:44:41.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1897924039' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:41.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2204615542' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:41.737 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 193.70 3.1M 3.0M 0.0k 31.4M 30.2M 0.0k nvme12n3 2026-02-18T03:44:41.737 INFO:tasks.workunit.client.0.trial014.stdout: 190.80 2.9M 3.1M 0.0k 29.1M 31.1M 0.0k nvme16n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 3.1M 3.0M 0.0k 30.9M 30.1M 0.0k nvme20n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.70 3.0M 2.9M 0.0k 30.4M 29.4M 0.0k nvme24n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.70 3.0M 3.1M 0.0k 29.8M 31.5M 0.0k nvme28n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 2.9M 2.9M 0.0k 29.2M 28.8M 0.0k nvme32n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 193.60 3.0M 3.0M 0.0k 30.1M 30.3M 0.0k nvme36n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.10 3.1M 3.0M 0.0k 31.5M 30.2M 0.0k nvme40n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 3.2M 3.1M 0.0k 31.5M 31.0M 0.0k nvme44n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 3.2M 3.0M 0.0k 31.9M 30.4M 0.0k nvme48n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 3.0M 3.2M 0.0k 30.1M 31.8M 0.0k nvme4n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 3.3M 3.1M 0.0k 33.4M 30.7M 0.0k nvme52n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.80 3.0M 3.1M 0.0k 30.3M 31.2M 0.0k nvme56n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 187.40 2.9M 3.1M 0.0k 28.8M 31.1M 0.0k nvme60n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 3.1M 3.1M 0.0k 31.0M 30.9M 0.0k nvme64n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 191.40 3.0M 3.0M 0.0k 29.7M 29.9M 0.0k nvme8n3 2026-02-18T03:44:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:41.922 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3679769376' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:42.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3679769376' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:42 trial034 ceph-mon[109579]: pgmap v656: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 44 MiB/s wr, 3.36k op/s 2026-02-18T03:44:43.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:42 trial086 ceph-mon[98535]: pgmap v656: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 44 MiB/s wr, 3.36k op/s 2026-02-18T03:44:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2758711423' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2758711423' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:45 trial086 ceph-mon[98535]: pgmap v657: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 55 MiB/s rd, 54 MiB/s wr, 3.94k op/s 2026-02-18T03:44:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:45 trial034 ceph-mon[109579]: pgmap v657: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 55 MiB/s rd, 54 MiB/s wr, 3.94k op/s 2026-02-18T03:44:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:47 trial086 ceph-mon[98535]: pgmap v658: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:44:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:47 trial034 ceph-mon[109579]: pgmap v658: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.27k op/s 2026-02-18T03:44:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/486478510' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2618253929' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2020004247' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/486478510' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2618253929' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2020004247' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:49 trial086 ceph-mon[98535]: pgmap v659: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.20k op/s 2026-02-18T03:44:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:49 trial034 ceph-mon[109579]: pgmap v659: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.20k op/s 2026-02-18T03:44:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:51 trial086 ceph-mon[98535]: pgmap v660: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.39k op/s 2026-02-18T03:44:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2534746157' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:51 trial034 ceph-mon[109579]: pgmap v660: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.39k op/s 2026-02-18T03:44:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2534746157' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:44:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 3.0M 3.1M 0.0k 30.5M 30.6M 0.0k nvme12n3 2026-02-18T03:44:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.90 3.1M 3.0M 0.0k 31.3M 29.8M 0.0k nvme16n3 2026-02-18T03:44:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 3.0M 3.0M 0.0k 29.8M 30.3M 0.0k nvme20n3 2026-02-18T03:44:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 3.1M 3.0M 0.0k 30.8M 30.2M 0.0k nvme24n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 3.0M 2.9M 0.0k 30.1M 28.8M 0.0k nvme28n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 3.0M 3.0M 0.0k 29.7M 29.5M 0.0k nvme32n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.60 2.9M 2.8M 0.0k 29.1M 28.2M 0.0k nvme36n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.9M 3.0M 0.0k 29.5M 30.2M 0.0k nvme40n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 2.9M 3.0M 0.0k 29.4M 29.7M 0.0k nvme44n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.7M 3.0M 0.0k 27.5M 30.3M 0.0k nvme48n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.9M 2.9M 0.0k 29.3M 28.8M 0.0k nvme4n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.80 3.0M 3.1M 0.0k 29.8M 30.6M 0.0k nvme52n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 3.0M 3.2M 0.0k 30.3M 32.3M 0.0k nvme56n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 2.9M 3.1M 0.0k 29.4M 31.1M 0.0k nvme60n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 3.1M 3.0M 0.0k 31.0M 29.9M 0.0k nvme64n3 2026-02-18T03:44:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 3.1M 3.0M 0.0k 30.6M 30.3M 0.0k nvme8n3 2026-02-18T03:44:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:44:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:53 trial086 ceph-mon[98535]: pgmap v661: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 2.98k op/s 2026-02-18T03:44:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:53 trial034 ceph-mon[109579]: pgmap v661: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 45 MiB/s wr, 2.98k op/s 2026-02-18T03:44:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:55 trial086 ceph-mon[98535]: pgmap v662: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 54 MiB/s rd, 54 MiB/s wr, 3.60k op/s 2026-02-18T03:44:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/354387419' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1513060666' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/63320859' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:55 trial034 ceph-mon[109579]: pgmap v662: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 54 MiB/s rd, 54 MiB/s wr, 3.60k op/s 2026-02-18T03:44:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/354387419' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1513060666' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/63320859' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:57 trial086 ceph-mon[98535]: pgmap v663: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.10k op/s 2026-02-18T03:44:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:57 trial034 ceph-mon[109579]: pgmap v663: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.10k op/s 2026-02-18T03:44:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2557404769' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2557404769' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:44:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:44:59 trial086 ceph-mon[98535]: pgmap v664: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.10k op/s 2026-02-18T03:44:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:44:59 trial034 ceph-mon[109579]: pgmap v664: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.10k op/s 2026-02-18T03:45:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:01 trial086 ceph-mon[98535]: pgmap v665: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:45:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:01 trial034 ceph-mon[109579]: pgmap v665: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:45:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:01.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 3.0M 2.9M 0.0k 30.1M 29.4M 0.0k nvme12n3 2026-02-18T03:45:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 3.0M 2.9M 0.0k 30.1M 28.5M 0.0k nvme16n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.9M 2.9M 0.0k 29.1M 28.8M 0.0k nvme20n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.9M 2.9M 0.0k 28.7M 29.4M 0.0k nvme24n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 2.8M 2.9M 0.0k 28.5M 29.0M 0.0k nvme28n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 2.7M 2.7M 0.0k 26.9M 27.5M 0.0k nvme32n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.8M 2.9M 0.0k 28.1M 28.6M 0.0k nvme36n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.9M 2.9M 0.0k 29.2M 29.2M 0.0k nvme40n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 2.9M 3.0M 0.0k 28.7M 29.6M 0.0k nvme44n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 2.7M 2.8M 0.0k 27.2M 28.2M 0.0k nvme48n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.8M 3.0M 0.0k 28.1M 30.2M 0.0k nvme4n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 3.0M 3.0M 0.0k 29.6M 29.7M 0.0k nvme52n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.70 2.8M 2.9M 0.0k 28.0M 29.1M 0.0k nvme56n3 2026-02-18T03:45:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 3.0M 2.8M 0.0k 30.1M 28.0M 0.0k nvme60n3 2026-02-18T03:45:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.90 3.0M 3.0M 0.0k 29.6M 30.0M 0.0k nvme64n3 2026-02-18T03:45:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.9M 2.9M 0.0k 29.0M 28.6M 0.0k nvme8n3 2026-02-18T03:45:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1011966578' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1631409345' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3381521983' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1011966578' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1631409345' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3381521983' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:03 trial086 ceph-mon[98535]: pgmap v666: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.98k op/s 2026-02-18T03:45:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:03 trial034 ceph-mon[109579]: pgmap v666: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.98k op/s 2026-02-18T03:45:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:05 trial086 ceph-mon[98535]: pgmap v667: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.62k op/s 2026-02-18T03:45:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1716061815' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:05 trial034 ceph-mon[109579]: pgmap v667: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.62k op/s 2026-02-18T03:45:05.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1716061815' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:07 trial086 ceph-mon[98535]: pgmap v668: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.12k op/s 2026-02-18T03:45:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:07 trial034 ceph-mon[109579]: pgmap v668: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.12k op/s 2026-02-18T03:45:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:09 trial086 ceph-mon[98535]: pgmap v669: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:45:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/954928785' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3436249755' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:09.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2985690970' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:09 trial034 ceph-mon[109579]: pgmap v669: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:45:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/954928785' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3436249755' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2985690970' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:11 trial034 ceph-mon[109579]: pgmap v670: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.33k op/s 2026-02-18T03:45:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:11 trial086 ceph-mon[98535]: pgmap v670: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.33k op/s 2026-02-18T03:45:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:11.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.8M 2.8M 0.0k 27.6M 28.4M 0.0k nvme12n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 189.40 2.6M 2.7M 0.0k 25.7M 26.6M 0.0k nvme16n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.7M 2.8M 0.0k 27.2M 28.3M 0.0k nvme20n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 3.0M 2.8M 0.0k 29.9M 27.6M 0.0k nvme24n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 3.1M 2.8M 0.0k 30.6M 27.9M 0.0k nvme28n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.8M 2.7M 0.0k 28.5M 27.5M 0.0k nvme32n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.8M 2.7M 0.0k 27.7M 27.4M 0.0k nvme36n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.7M 2.7M 0.0k 26.9M 27.3M 0.0k nvme40n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.8M 2.8M 0.0k 27.6M 28.3M 0.0k nvme44n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 2.7M 2.7M 0.0k 26.8M 27.2M 0.0k nvme48n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.9M 2.9M 0.0k 29.1M 28.8M 0.0k nvme4n3 2026-02-18T03:45:11.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.60 2.6M 3.0M 0.0k 26.2M 29.7M 0.0k nvme52n3 2026-02-18T03:45:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.90 2.8M 2.8M 0.0k 27.8M 28.3M 0.0k nvme56n3 2026-02-18T03:45:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.70 2.7M 2.7M 0.0k 26.9M 27.2M 0.0k nvme60n3 2026-02-18T03:45:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.9M 2.9M 0.0k 29.0M 29.0M 0.0k nvme64n3 2026-02-18T03:45:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 3.1M 2.8M 0.0k 30.6M 27.7M 0.0k nvme8n3 2026-02-18T03:45:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/831829503' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:12.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/831829503' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:13 trial086 ceph-mon[98535]: pgmap v671: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.98k op/s 2026-02-18T03:45:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:13 trial034 ceph-mon[109579]: pgmap v671: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.98k op/s 2026-02-18T03:45:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:15 trial086 ceph-mon[98535]: pgmap v672: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:45:15.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:15 trial034 ceph-mon[109579]: pgmap v672: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:45:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1287459754' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3752490545' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2638688217' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:16.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1287459754' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3752490545' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2638688217' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:17 trial086 ceph-mon[98535]: pgmap v673: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.10k op/s 2026-02-18T03:45:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:17 trial034 ceph-mon[109579]: pgmap v673: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.10k op/s 2026-02-18T03:45:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:19 trial086 ceph-mon[98535]: pgmap v674: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.11k op/s 2026-02-18T03:45:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1143971926' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:19.512 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:45:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:19 trial034 ceph-mon[109579]: pgmap v674: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.11k op/s 2026-02-18T03:45:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:19 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1143971926' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:21 trial086 ceph-mon[98535]: pgmap v675: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:45:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:21 trial034 ceph-mon[109579]: pgmap v675: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:45:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.8M 2.6M 0.0k 27.9M 26.5M 0.0k nvme12n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 2.5M 2.8M 0.0k 25.5M 27.9M 0.0k nvme16n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.9M 2.7M 0.0k 28.9M 27.4M 0.0k nvme20n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.8M 2.7M 0.0k 27.8M 26.7M 0.0k nvme24n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 2.7M 2.8M 0.0k 27.1M 28.4M 0.0k nvme28n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.7M 2.7M 0.0k 27.2M 27.2M 0.0k nvme32n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 2.9M 2.7M 0.0k 28.6M 27.3M 0.0k nvme36n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.7M 2.7M 0.0k 27.2M 26.8M 0.0k nvme40n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.6M 2.8M 0.0k 26.2M 28.1M 0.0k nvme44n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.7M 2.7M 0.0k 27.2M 26.6M 0.0k nvme48n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.8M 2.7M 0.0k 27.6M 27.4M 0.0k nvme4n3 2026-02-18T03:45:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.8M 2.7M 0.0k 28.0M 27.3M 0.0k nvme52n3 2026-02-18T03:45:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.6M 2.8M 0.0k 26.2M 27.8M 0.0k nvme56n3 2026-02-18T03:45:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 3.0M 3.0M 0.0k 29.9M 29.8M 0.0k nvme60n3 2026-02-18T03:45:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.9M 2.6M 0.0k 29.1M 26.3M 0.0k nvme64n3 2026-02-18T03:45:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.6M 2.7M 0.0k 25.6M 26.6M 0.0k nvme8n3 2026-02-18T03:45:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: pgmap v676: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2096827736' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2208689624' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1201062801' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:23.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:23.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:23 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: pgmap v676: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:45:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2096827736' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2208689624' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1201062801' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:23.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:23.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:23.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:23.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:23 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:25 trial086 ceph-mon[98535]: pgmap v677: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 49 MiB/s wr, 3.62k op/s 2026-02-18T03:45:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:25 trial034 ceph-mon[109579]: pgmap v677: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 49 MiB/s wr, 3.62k op/s 2026-02-18T03:45:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2219874845' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:26.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2219874845' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:27 trial086 ceph-mon[98535]: pgmap v678: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.11k op/s 2026-02-18T03:45:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:27 trial034 ceph-mon[109579]: pgmap v678: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.11k op/s 2026-02-18T03:45:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:29 trial086 ceph-mon[98535]: pgmap v679: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.12k op/s 2026-02-18T03:45:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:29 trial034 ceph-mon[109579]: pgmap v679: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.12k op/s 2026-02-18T03:45:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/884800919' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1062361936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2102428459' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/884800919' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1062361936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:30.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2102428459' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:31 trial086 ceph-mon[98535]: pgmap v680: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:45:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:31 trial034 ceph-mon[109579]: pgmap v680: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:45:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.7M 2.6M 0.0k 26.8M 26.0M 0.0k nvme12n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.5M 2.6M 0.0k 25.0M 25.7M 0.0k nvme16n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.7M 2.6M 0.0k 27.0M 26.4M 0.0k nvme20n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.9M 2.7M 0.0k 28.5M 26.6M 0.0k nvme24n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.5M 2.7M 0.0k 25.3M 27.0M 0.0k nvme28n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 212.40 2.7M 2.5M 0.0k 27.2M 25.2M 0.0k nvme32n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.7M 2.6M 0.0k 26.8M 26.0M 0.0k nvme36n3 2026-02-18T03:45:31.738 INFO:tasks.workunit.client.0.trial014.stdout: 200.00 2.6M 2.6M 0.0k 25.9M 25.7M 0.0k nvme40n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.5M 2.7M 0.0k 25.2M 26.6M 0.0k nvme44n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 189.60 2.3M 2.6M 0.0k 22.5M 26.3M 0.0k nvme48n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 2.6M 2.7M 0.0k 25.8M 27.1M 0.0k nvme4n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.5M 2.7M 0.0k 25.4M 26.8M 0.0k nvme52n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 2.6M 2.8M 0.0k 25.7M 27.7M 0.0k nvme56n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.20 2.6M 2.6M 0.0k 26.1M 25.8M 0.0k nvme60n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 2.5M 2.8M 0.0k 25.2M 27.7M 0.0k nvme64n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.6M 2.6M 0.0k 26.3M 25.9M 0.0k nvme8n3 2026-02-18T03:45:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:33 trial086 ceph-mon[98535]: pgmap v681: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 2.98k op/s 2026-02-18T03:45:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2745947361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:33 trial034 ceph-mon[109579]: pgmap v681: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 2.98k op/s 2026-02-18T03:45:33.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2745947361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:35 trial086 ceph-mon[98535]: pgmap v682: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.61k op/s 2026-02-18T03:45:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:35 trial034 ceph-mon[109579]: pgmap v682: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.61k op/s 2026-02-18T03:45:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:37 trial086 ceph-mon[98535]: pgmap v683: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.11k op/s 2026-02-18T03:45:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2156146548' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/305514266' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1724167601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:37 trial034 ceph-mon[109579]: pgmap v683: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.11k op/s 2026-02-18T03:45:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2156146548' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/305514266' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1724167601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:39.112 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #6: thrashed- nvmeof.c (by daemon_remove); 2026-02-18T03:45:39.112 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:45:39.112 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:45:39.139 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 9min ago 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 378.0M (peak: 381.8M) 2026-02-18T03:45:39.140 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 39min 10.353s 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:45:39.141 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:45:39.142 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:54432 2026-02-18T03:45:39.144 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 5min ago 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 347.9M (peak: 352.8M) 2026-02-18T03:45:39.171 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 22min 54.179s 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:45:39.172 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:45:39.173 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185440] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185452] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185800] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185817] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186164] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186179] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:45:39.174 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186529] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:45:39.175 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186554] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:45:39.175 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186894] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:45:39.175 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186919] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:45:39.175 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:45:39.213 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:44:19 UTC; 1min 19s ago 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91482 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91483 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 91554 (conmon) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 318.4M (peak: 320.3M) 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 5min 9.788s 2026-02-18T03:45:39.214 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91556 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91558 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91650 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─92256 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: │ └─92321 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: └─91554 /usr/bin/conmon --api-version 1 -c 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -u 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata -p /run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:45:39.215 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.718844] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000304 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.730690] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000322 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.746717] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000332 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.762675] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000322 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.778705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000343 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.794719] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000331 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.810664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000283 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.826721] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000335 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.842646] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000267 seconds 2026-02-18T03:45:39.216 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.858687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000281 seconds 2026-02-18T03:45:39.217 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:45:39.258 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:39.258 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:45:39.258 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 2min 56s ago 2026-02-18T03:45:39.258 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.258 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 361.4M (peak: 363.6M) 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 12min 750ms 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:45:39.259 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.058805] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000171 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.074781] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000148 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.098833] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000198 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:45:39.260 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:45:39.261 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:45:39.261 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:45:39.262 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:45:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:39 trial086 ceph-mon[98535]: pgmap v684: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.13k op/s 2026-02-18T03:45:39.488 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:45:39.488 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 8m ago 20m trial034=x;count:1 2026-02-18T03:45:39.488 INFO:teuthology.orchestra.run.trial177.stdout:mon 2/3 8m ago 20m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:45:39.488 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 8m ago 19m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:45:39.488 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 8m ago 19m trial155 2026-02-18T03:45:39.497 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:45:39.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:39 trial034 ceph-mon[109579]: pgmap v684: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.13k op/s 2026-02-18T03:45:39.683 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:45:39.683 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (9m) 8m ago 9m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:45:39.683 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (5m) 5m ago 9m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:45:39.683 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (79s) 77s ago 79s 53.8M - 1.6.5 99a57256b38c 6656e6ed9326 2026-02-18T03:45:39.683 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (2m) 2m ago 9m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:45:39.692 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:45:39.910 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:45:39.910 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:45:39.910 INFO:teuthology.orchestra.run.trial177.stdout: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:45:39.919 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,b 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,b (age 81s) [leader: a], out of quorum: c 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 21m) 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 19m), 8 in (since 19m) 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: usage: 53 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:45:40.143 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:45:40.144 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:45:40.144 INFO:teuthology.orchestra.run.trial177.stdout: client: 43 MiB/s rd, 43 MiB/s wr, 1.68k op/s rd, 1.66k op/s wr 2026-02-18T03:45:40.144 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:45:40.152 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:45:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2758912341' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:45:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1715621181' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 213, 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 2, 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 137, 2026-02-18T03:45:40.388 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:45:40.389 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:45:40.390 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:45:40.391 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:45:40.392 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:45:40.398 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.456 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.457 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.458 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.459 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.460 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.461 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.462 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.462 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.462 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.462 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:45:40.463 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:45:40.510 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.510 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:45:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2758912341' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:45:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1715621181' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:40.556 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.557 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:45:40.602 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.603 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:45:40.649 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.649 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:45:40.695 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.695 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:45:40.739 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.740 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:45:40.825 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.825 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:45:40.869 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.871 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:45:40.917 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.917 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:45:40.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:40.963 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:45:41.009 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.010 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:45:41.053 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.054 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:45:41.098 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.099 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:45:41.185 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.186 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:45:41.230 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.231 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:45:41.276 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.277 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:45:41.324 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.325 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:45:41.371 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.371 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:45:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:41 trial086 ceph-mon[98535]: from='client.121227 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:41 trial086 ceph-mon[98535]: from='client.107939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:41 trial086 ceph-mon[98535]: pgmap v685: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:45:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/94824160' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:45:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2308936399' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:45:41.417 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.418 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:45:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:41 trial034 ceph-mon[109579]: from='client.121227 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:41 trial034 ceph-mon[109579]: from='client.107939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:41 trial034 ceph-mon[109579]: pgmap v685: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:45:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/94824160' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:45:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2308936399' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:45:41.463 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.463 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:45:41.509 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.510 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:45:41.555 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.555 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:45:41.600 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.601 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:45:41.646 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.647 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:45:41.692 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.694 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:45:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:41.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.10 2.7M 2.6M 0.0k 27.2M 26.4M 0.0k nvme12n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.4M 2.6M 0.0k 24.4M 26.0M 0.0k nvme16n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.6M 2.5M 0.0k 25.5M 24.6M 0.0k nvme20n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.7M 2.6M 0.0k 27.1M 26.3M 0.0k nvme24n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.6M 2.7M 0.0k 26.3M 26.5M 0.0k nvme28n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.3M 2.4M 0.0k 22.8M 23.9M 0.0k nvme32n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.4M 2.5M 0.0k 24.3M 25.3M 0.0k nvme36n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.6M 2.5M 0.0k 25.5M 25.3M 0.0k nvme40n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 2.4M 2.6M 0.0k 24.1M 26.0M 0.0k nvme44n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.50 2.5M 2.4M 0.0k 24.9M 24.1M 0.0k nvme48n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 212.00 3.0M 2.5M 0.0k 29.7M 25.5M 0.0k nvme4n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.80 2.8M 2.7M 0.0k 28.0M 27.2M 0.0k nvme52n3 2026-02-18T03:45:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 2.7M 2.7M 0.0k 27.1M 26.7M 0.0k nvme56n3 2026-02-18T03:45:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 2.5M 2.6M 0.0k 25.0M 25.9M 0.0k nvme60n3 2026-02-18T03:45:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 2.7M 2.6M 0.0k 27.5M 26.2M 0.0k nvme64n3 2026-02-18T03:45:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 193.30 2.5M 2.4M 0.0k 24.8M 24.3M 0.0k nvme8n3 2026-02-18T03:45:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:41.742 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.742 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:45:41.828 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.828 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:45:41.874 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.875 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:45:41.920 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.921 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:45:41.966 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:41.967 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:45:42.012 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.013 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:45:42.058 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.059 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:45:42.104 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.106 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:45:42.152 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.152 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:45:42.196 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.198 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:45:42.243 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.243 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:45:42.288 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.289 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:45:42.334 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.334 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:45:42.419 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.421 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:45:42.466 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.467 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:45:42.511 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.512 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:45:42.556 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.557 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:45:42.601 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.602 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:45:42.646 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.648 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:45:42.694 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.694 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:45:42.740 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.741 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:45:42.786 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.787 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:45:42.833 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.834 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:45:42.880 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.880 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:45:42.926 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.927 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:45:42.972 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:42.973 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:45:43.019 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.019 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:45:43.063 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.064 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:45:43.114 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.114 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:45:43.209 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.210 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:45:43.310 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.311 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:45:43.356 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.356 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:45:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:43 trial086 ceph-mon[98535]: pgmap v686: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.01k op/s 2026-02-18T03:45:43.402 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.403 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:45:43.448 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.448 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:45:43.493 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.494 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:45:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:43 trial034 ceph-mon[109579]: pgmap v686: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.01k op/s 2026-02-18T03:45:43.579 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.579 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:45:43.624 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.625 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:45:43.670 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.670 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:45:43.716 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:45:43.717 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:45:43.717 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:45:43.717 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.c 2026-02-18T03:45:43.717 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon start nvmeof.nvmeof.c 2026-02-18T03:45:43.718 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:45:43.718 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.c 2026-02-18T03:45:43.718 INFO:tasks.cephadm.mon.c:Restarting mon.c (starting--it wasn't running)... 2026-02-18T03:45:43.718 DEBUG:teuthology.orchestra.run.trial155:mon.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service 2026-02-18T03:45:43.722 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:45:43.967 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to start nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:45:43.978 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:45:43.978 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:45:43.979 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 82 secs before thrashing 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 systemd[1]: Starting Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 podman[102216]: 2026-02-18 03:45:43.921320474 +0000 UTC m=+0.018234286 container create 9da4c5d7fdda610872f6d32d6a4a60f2bddfd65eed1eccaf1996d291a9ae4f3c (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 podman[102216]: 2026-02-18 03:45:43.966366632 +0000 UTC m=+0.063280454 container init 9da4c5d7fdda610872f6d32d6a4a60f2bddfd65eed1eccaf1996d291a9ae4f3c (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 podman[102216]: 2026-02-18 03:45:43.969446992 +0000 UTC m=+0.066360804 container start 9da4c5d7fdda610872f6d32d6a4a60f2bddfd65eed1eccaf1996d291a9ae4f3c (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 bash[102216]: 9da4c5d7fdda610872f6d32d6a4a60f2bddfd65eed1eccaf1996d291a9ae4f3c 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 podman[102216]: 2026-02-18 03:45:43.914675146 +0000 UTC m=+0.011588968 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:45:43.998 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 systemd[1]: Started Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:45:43.999 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 ceph-mon[102239]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:45:43.999 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 ceph-mon[102239]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:45:43.999 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 ceph-mon[102239]: pidfile_write: ignore empty --pid-file 2026-02-18T03:45:44.227 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":48,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":85,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/209000071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2210952849' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1757980950' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:44.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:44.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:44 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/209000071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2210952849' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1757980950' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:44.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:44 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:44.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:43 trial155 ceph-mon[102239]: load: jerasure load: lrc 2026-02-18T03:45:44.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:45:44.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Git sha 0 2026-02-18T03:45:44.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:45:44.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: DB SUMMARY 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: DB Session ID: 99HP3R85OANVKRPSR4Q9 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: MANIFEST file: MANIFEST-000036 size: 1766 Bytes 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000056.sst 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000054.log size: 215851 ; 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:45:44.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.env: 0x558f6c51e100 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.info_log: 0x558f70fece80 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.statistics: (nil) 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.use_fsync: 0 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:45:44.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.db_log_dir: 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.wal_dir: 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:45:44.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.write_buffer_manager: 0x558f70ff0b40 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:45:44.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.unordered_write: 0 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.row_cache: None 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.wal_filter: None 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:45:44.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.wal_compression: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:45:44.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:45:44.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_open_files: -1 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Compression algorithms supported: 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kZSTD supported: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:45:44.488 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000036 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.merge_operator: 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_filter: None 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:45:44.489 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558f70fec3c0) 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: index_type: 0 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_index_type: 0 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: index_shortening: 1 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: checksum: 4 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: no_block_cache: 0 2026-02-18T03:45:44.490 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache: 0x558f7100db90 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_options: 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: capacity : 536870912 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: num_shard_bits : 4 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: strict_capacity_limit : 0 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_compressed: (nil) 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: persistent_cache: (nil) 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size: 4096 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size_deviation: 10 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: block_restart_interval: 16 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: index_block_restart_interval: 1 2026-02-18T03:45:44.491 INFO:journalctl@ceph.mon.c.trial155.stdout: metadata_block_size: 4096 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: partition_filters: 0 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: use_delta_encoding: 1 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: filter_policy: bloomfilter 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: whole_key_filtering: 1 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: verify_compression: 0 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: format_version: 5 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_index_compression: 1 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: block_align: 0 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: max_auto_readahead_size: 262144 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: prepopulate_block_cache: 0 2026-02-18T03:45:44.492 INFO:journalctl@ceph.mon.c.trial155.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression: NoCompression 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.num_levels: 7 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:45:44.493 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:45:44.494 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:45:44.495 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:45:44.496 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:45:44.497 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.ttl: 2592000 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:45:44.498 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:45:44.499 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000036 succeeded,manifest_file_number is 36, next_file_number is 58, last_sequence is 22792, log_number is 54,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 54 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 54 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 711ce751-a115-4d3b-ae33-6c3f58e6c51c 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386344001272, "job": 1, "event": "recovery_started", "wal_files": [54]} 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #54 mode 2 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386344002368, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 59, "file_size": 142592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 22797, "largest_seqno": 22958, "table_properties": {"data_size": 140946, "index_size": 417, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1469, "raw_average_key_size": 21, "raw_value_size": 139519, "raw_average_value_size": 2082, "num_data_blocks": 19, "num_entries": 67, "num_filter_entries": 67, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771386344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "711ce751-a115-4d3b-ae33-6c3f58e6c51c", "db_session_id": "99HP3R85OANVKRPSR4Q9", "orig_file_number": 59, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386344002442, "job": 1, "event": "recovery_finished"} 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:5047] Creating manifest 61 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000054.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:45:44.500 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558f71010700 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: DB pointer 0x558f71022000 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: ** DB Stats ** 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:45:44.501 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: L0 1/0 139.25 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 179.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: L6 1/0 7.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: Sum 2/0 7.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 179.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 179.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:45:44.502 INFO:journalctl@ceph.mon.c.trial155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 179.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative compaction: 0.00 GB write, 41.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval compaction: 0.00 GB write, 41.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:45:44.503 INFO:journalctl@ceph.mon.c.trial155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache BinnedLRUCache@0x558f7100db90#2 capacity: 512.00 MB usage: 0.76 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.24 KB,4.61936e-05%) IndexBlock(1,0.52 KB,9.83477e-05%) Misc(1,0.00 KB,0%) 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: starting mon.c rank 1 at public addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] at bind addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).mds e1 new map 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).mds e1 print_map 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: e1 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:45:44.504 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout: legacy client fscid: -1 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout: No filesystems configured 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).osd e57 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).osd e57 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).osd e57 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).osd e57 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:45:44.505 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:44 trial155 ceph-mon[102239]: mon.c@-1(???).paxosservice(auth 1..45) refresh upgraded, format 0 -> 3 2026-02-18T03:45:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: pgmap v687: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.64k op/s 2026-02-18T03:45:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='client.121272 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1212696653' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:45 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v665: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 49 MiB/s wr, 3.32k op/s 2026-02-18T03:45:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1011966578' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/1631409345' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/3381521983' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v666: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.98k op/s 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v667: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 53 MiB/s wr, 3.62k op/s 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1716061815' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v668: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.12k op/s 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v669: 33 pgs: 33 active+clean; 16 GiB data, 52 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.13k op/s 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/954928785' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3436249755' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2985690970' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v670: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 47 MiB/s wr, 3.33k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/831829503' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v671: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.98k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v672: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.62k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1287459754' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3752490545' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2638688217' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v673: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.10k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v674: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.11k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1143971926' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v675: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v676: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 2.98k op/s 2026-02-18T03:45:45.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/2096827736' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2208689624' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1201062801' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:45.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v677: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 49 MiB/s wr, 3.62k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/2219874845' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v678: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.11k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v679: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.12k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/884800919' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/1062361936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2102428459' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v680: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.32k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v681: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 2.98k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/2745947361' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v682: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 48 MiB/s wr, 3.61k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v683: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.11k op/s 2026-02-18T03:45:45.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/2156146548' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/305514266' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1724167601' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v684: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.13k op/s 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2758912341' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1715621181' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.121227 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.107939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v685: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.34k op/s 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/94824160' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2308936399' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v686: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 38 MiB/s wr, 3.01k op/s 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/209000071' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2210952849' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1757980950' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: pgmap v687: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.64k op/s 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.121272 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:45:45.486 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1212696653' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.487 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:45 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: pgmap v687: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.64k op/s 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='client.121272 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "start", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: Schedule start daemon nvmeof.nvmeof.c 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1212696653' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:45:45.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:45:45.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:45:45.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:45 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:45:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:45:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:45:46.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:45:46.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 21m) 2026-02-18T03:45:46.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:45:46.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:45:46.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:46 trial086 ceph-mon[98535]: overall HEALTH_OK 2026-02-18T03:45:46.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: mon.c calling monitor election 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: mon.a calling monitor election 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: monmap epoch 3 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: min_mon_release 20 (tentacle) 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: election_strategy: 1 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:45:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: fsmap 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: mgrmap e15: x(active, since 21m) 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: Cluster is now healthy 2026-02-18T03:45:46.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:46 trial155 ceph-mon[102239]: overall HEALTH_OK 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: mon.c calling monitor election 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: monmap epoch 3 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: min_mon_release 20 (tentacle) 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: election_strategy: 1 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:45:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: fsmap 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: mgrmap e15: x(active, since 21m) 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: Cluster is now healthy 2026-02-18T03:45:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:46 trial034 ceph-mon[109579]: overall HEALTH_OK 2026-02-18T03:45:47.239 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:45:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:47 trial155 ceph-mon[102239]: pgmap v688: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:47 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1864799081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:47.489 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:45:47.500 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:47 trial034 ceph-mon[109579]: pgmap v688: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:47.500 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1864799081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:47.501 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:45:47.501 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:45:47.501 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:45:47.580 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:45:47.580 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:45:47.580 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:45:47.580 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:45:47.580 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 184992, 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:45:47.581 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:45:47.582 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.583 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.584 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "num": 40 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:45:47.585 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:45:47.586 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:45:47.586 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:45:47.586 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:45:47.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:47 trial086 ceph-mon[98535]: pgmap v688: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:47.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1864799081' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 355724, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.666 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.667 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.668 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:45:47.669 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "num": 106 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:45:47.670 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:45:47.672 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:45:47.672 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:45:47.672 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 3745, 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:45:47.751 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.752 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:45:47.753 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:45:47.754 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.755 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:45:47.756 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:45:47.759 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:45:47.759 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:45:47.759 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:45:48.030 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2229356773' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2209039985' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:45:48.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {auth=56,config=2,health=13,kv=29} crc {auth=4200976512,config=1466402343,health=3596560993,kv=733263698}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2028165710}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {kv=40,logm=60} crc {kv=2744620306,logm=1027946825}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=797515893}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=155724656}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2042395059}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=67356837}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928664772}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37589550}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1952076576}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3986125990}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2045563558}) 2026-02-18T03:45:48.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3238244772}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4267291706}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3291171146}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3494410110}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=151246996}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3947615973}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2924094155}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337121110}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1082300858}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2970336905}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149882635}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3714207756}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685387590}) 2026-02-18T03:45:48.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475528421}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3785918970}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=528378244}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2028842321}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3744432081}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1104998686}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2440322888}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420771701}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1960917404}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210838241}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=441192342}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:45:48.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {logm=58,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=19} crc {logm=1897565818,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1780168987}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=67,mon_config_key=33} crc {mgrstat=2309977725,mon_config_key=3938681992}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1075526825}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=86,monmap=5,nvmeofgw=9} crc {mon_config_key=4109666080,monmap=1407976167,nvmeofgw=3127230836}) 2026-02-18T03:45:48.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1905275362}) 2026-02-18T03:45:48.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=333925415}) 2026-02-18T03:45:48.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=8,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=81} crc {nvmeofgw=888968230,osd_metadata=2727074769,osd_pg_creating=2420761471,osd_snap=3842414688,osdmap=96231593}) 2026-02-18T03:45:48.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:48 trial155 ceph-mon[102239]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=1011969325}) 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2229356773' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2209039985' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {auth=56,config=2,health=13,kv=29} crc {auth=4200976512,config=1466402343,health=3596560993,kv=733263698}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2028165710}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {kv=40,logm=60} crc {kv=2744620306,logm=1027946825}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=797515893}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=155724656}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2042395059}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=67356837}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928664772}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37589550}) 2026-02-18T03:45:48.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1952076576}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3986125990}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2045563558}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3238244772}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4267291706}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3291171146}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3494410110}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=151246996}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3947615973}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2924094155}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337121110}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1082300858}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2970336905}) 2026-02-18T03:45:48.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149882635}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3714207756}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685387590}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475528421}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3785918970}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=528378244}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2028842321}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3744432081}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1104998686}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2440322888}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420771701}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1960917404}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210838241}) 2026-02-18T03:45:48.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=441192342}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=58,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=19} crc {logm=1897565818,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1780168987}) 2026-02-18T03:45:48.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=67,mon_config_key=33} crc {mgrstat=2309977725,mon_config_key=3938681992}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1075526825}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=86,monmap=5,nvmeofgw=9} crc {mon_config_key=4109666080,monmap=1407976167,nvmeofgw=3127230836}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1905275362}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=333925415}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=8,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=81} crc {nvmeofgw=888968230,osd_metadata=2727074769,osd_pg_creating=2420761471,osd_snap=3842414688,osdmap=96231593}) 2026-02-18T03:45:48.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:48 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=1011969325}) 2026-02-18T03:45:48.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2229356773' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2209039985' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {auth=56,config=2,health=13,kv=29} crc {auth=4200976512,config=1466402343,health=3596560993,kv=733263698}) 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=2028165710}) 2026-02-18T03:45:48.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=40,logm=60} crc {kv=2744620306,logm=1027946825}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=797515893}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=155724656}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2042395059}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=67356837}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928664772}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=37589550}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1952076576}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3986125990}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2045563558}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3238244772}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4267291706}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3291171146}) 2026-02-18T03:45:48.625 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3494410110}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=151246996}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3947615973}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2924094155}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337121110}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1082300858}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2970336905}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1149882635}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3714207756}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685387590}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475528421}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3785918970}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=528378244}) 2026-02-18T03:45:48.626 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2028842321}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3744432081}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1104998686}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2440322888}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420771701}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1960917404}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210838241}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=441192342}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:45:48.627 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=58,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=19} crc {logm=1897565818,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1780168987}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=67,mon_config_key=33} crc {mgrstat=2309977725,mon_config_key=3938681992}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1075526825}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=86,monmap=5,nvmeofgw=9} crc {mon_config_key=4109666080,monmap=1407976167,nvmeofgw=3127230836}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1905275362}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=333925415}) 2026-02-18T03:45:48.628 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=8,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=81} crc {nvmeofgw=888968230,osd_metadata=2727074769,osd_pg_creating=2420761471,osd_snap=3842414688,osdmap=96231593}) 2026-02-18T03:45:48.629 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:48 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=40} crc {osdmap=1011969325}) 2026-02-18T03:45:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:49 trial155 ceph-mon[102239]: pgmap v689: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:49 trial034 ceph-mon[109579]: pgmap v689: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:49.523 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:49 trial086 ceph-mon[98535]: pgmap v689: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.12k op/s 2026-02-18T03:45:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:51 trial155 ceph-mon[102239]: pgmap v690: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.31k op/s 2026-02-18T03:45:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:51 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/2256478627' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:51 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/835145294' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:51 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/633339104' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:51 trial034 ceph-mon[109579]: pgmap v690: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.31k op/s 2026-02-18T03:45:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2256478627' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/835145294' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/633339104' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:51 trial086 ceph-mon[98535]: pgmap v690: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.31k op/s 2026-02-18T03:45:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2256478627' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/835145294' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/633339104' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.40 2.8M 2.5M 0.0k 27.6M 24.6M 0.0k nvme12n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 2.6M 2.4M 0.0k 25.6M 24.4M 0.0k nvme16n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.3M 2.4M 0.0k 22.6M 24.1M 0.0k nvme20n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.5M 2.5M 0.0k 25.3M 24.6M 0.0k nvme24n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.6M 2.3M 0.0k 25.5M 23.0M 0.0k nvme28n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 2.3M 2.5M 0.0k 22.6M 24.6M 0.0k nvme32n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 2.4M 2.5M 0.0k 23.7M 25.4M 0.0k nvme36n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.20 2.3M 2.4M 0.0k 23.0M 23.7M 0.0k nvme40n3 2026-02-18T03:45:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.5M 2.6M 0.0k 24.9M 25.6M 0.0k nvme44n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.3M 2.5M 0.0k 23.4M 25.0M 0.0k nvme48n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.40 2.5M 2.4M 0.0k 25.5M 23.9M 0.0k nvme4n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 2.6M 2.6M 0.0k 25.5M 26.1M 0.0k nvme52n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.7M 2.5M 0.0k 27.1M 24.9M 0.0k nvme56n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.30 2.4M 2.4M 0.0k 24.0M 24.1M 0.0k nvme60n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 193.30 2.4M 2.4M 0.0k 24.4M 24.3M 0.0k nvme64n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 189.30 2.3M 2.4M 0.0k 23.3M 24.0M 0.0k nvme8n3 2026-02-18T03:45:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:45:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:53 trial155 ceph-mon[102239]: pgmap v691: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.97k op/s 2026-02-18T03:45:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:53 trial034 ceph-mon[109579]: pgmap v691: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.97k op/s 2026-02-18T03:45:53.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:53 trial086 ceph-mon[98535]: pgmap v691: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.97k op/s 2026-02-18T03:45:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:54 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/6898315' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/6898315' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/6898315' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:55 trial155 ceph-mon[102239]: pgmap v692: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:45:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:55 trial034 ceph-mon[109579]: pgmap v692: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:45:55.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:55 trial086 ceph-mon[98535]: pgmap v692: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.60k op/s 2026-02-18T03:45:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:57 trial155 ceph-mon[102239]: pgmap v693: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.09k op/s 2026-02-18T03:45:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:57 trial034 ceph-mon[109579]: pgmap v693: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.09k op/s 2026-02-18T03:45:57.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:57 trial086 ceph-mon[98535]: pgmap v693: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.09k op/s 2026-02-18T03:45:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:58 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1043065172' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:58 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3440387832' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:58 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/75446201' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1043065172' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3440387832' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/75446201' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1043065172' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3440387832' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:58.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/75446201' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:45:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:45:59 trial155 ceph-mon[102239]: pgmap v694: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.80k op/s 2026-02-18T03:45:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:45:59 trial034 ceph-mon[109579]: pgmap v694: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.80k op/s 2026-02-18T03:45:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:45:59 trial086 ceph-mon[98535]: pgmap v694: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.80k op/s 2026-02-18T03:46:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:01 trial155 ceph-mon[102239]: pgmap v695: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.31k op/s 2026-02-18T03:46:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:01 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/536533765' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:01 trial034 ceph-mon[109579]: pgmap v695: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.31k op/s 2026-02-18T03:46:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/536533765' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:01 trial086 ceph-mon[98535]: pgmap v695: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.31k op/s 2026-02-18T03:46:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/536533765' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:01.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 2.5M 2.5M 0.0k 25.3M 24.8M 0.0k nvme12n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.3M 2.4M 0.0k 22.6M 23.8M 0.0k nvme16n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 198.90 2.3M 2.4M 0.0k 22.6M 24.2M 0.0k nvme20n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.5M 2.3M 0.0k 25.1M 23.3M 0.0k nvme24n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.2M 2.4M 0.0k 22.3M 24.1M 0.0k nvme28n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 2.5M 2.3M 0.0k 24.6M 23.4M 0.0k nvme32n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 2.2M 2.4M 0.0k 22.4M 23.8M 0.0k nvme36n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.4M 2.4M 0.0k 23.7M 24.1M 0.0k nvme40n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.5M 2.4M 0.0k 24.7M 23.7M 0.0k nvme44n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 210.00 2.5M 2.3M 0.0k 25.1M 22.8M 0.0k nvme48n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.3M 2.4M 0.0k 23.5M 23.9M 0.0k nvme4n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 191.40 2.3M 2.3M 0.0k 23.1M 23.2M 0.0k nvme52n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 2.4M 2.5M 0.0k 24.1M 25.0M 0.0k nvme56n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 2.3M 2.5M 0.0k 23.0M 24.9M 0.0k nvme60n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 189.90 2.3M 2.4M 0.0k 22.6M 24.3M 0.0k nvme64n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.70 2.2M 2.4M 0.0k 22.1M 23.6M 0.0k nvme8n3 2026-02-18T03:46:01.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:03 trial155 ceph-mon[102239]: pgmap v696: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:46:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:03 trial034 ceph-mon[109579]: pgmap v696: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:46:03.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:03 trial086 ceph-mon[98535]: pgmap v696: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:46:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:05 trial155 ceph-mon[102239]: pgmap v697: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:46:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:05 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/544373538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:05 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/4233074878' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:05 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/4186339241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:05 trial034 ceph-mon[109579]: pgmap v697: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:46:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/544373538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4233074878' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/4186339241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:05 trial086 ceph-mon[98535]: pgmap v697: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.61k op/s 2026-02-18T03:46:05.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/544373538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4233074878' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:05.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4186339241' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:07 trial155 ceph-mon[102239]: pgmap v698: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.10k op/s 2026-02-18T03:46:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:07 trial034 ceph-mon[109579]: pgmap v698: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.10k op/s 2026-02-18T03:46:07.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:07 trial086 ceph-mon[98535]: pgmap v698: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.10k op/s 2026-02-18T03:46:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:08 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/3342597456' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3342597456' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:08.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3342597456' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:09 trial155 ceph-mon[102239]: pgmap v699: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.81k op/s 2026-02-18T03:46:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:09 trial034 ceph-mon[109579]: pgmap v699: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.81k op/s 2026-02-18T03:46:09.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:09 trial086 ceph-mon[98535]: pgmap v699: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.81k op/s 2026-02-18T03:46:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:11 trial155 ceph-mon[102239]: pgmap v700: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.62k op/s 2026-02-18T03:46:11.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:11 trial034 ceph-mon[109579]: pgmap v700: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.62k op/s 2026-02-18T03:46:11.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:11 trial086 ceph-mon[98535]: pgmap v700: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 43 MiB/s wr, 3.62k op/s 2026-02-18T03:46:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.2M 2.3M 0.0k 22.1M 23.3M 0.0k nvme12n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 2.3M 2.3M 0.0k 22.6M 23.0M 0.0k nvme16n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.3M 2.4M 0.0k 23.3M 23.8M 0.0k nvme20n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.5M 2.4M 0.0k 24.7M 23.7M 0.0k nvme24n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.5M 2.3M 0.0k 24.8M 23.2M 0.0k nvme28n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 208.80 2.2M 2.3M 0.0k 22.5M 23.1M 0.0k nvme32n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 207.90 2.5M 2.4M 0.0k 24.5M 23.6M 0.0k nvme36n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 2.4M 2.3M 0.0k 24.3M 23.1M 0.0k nvme40n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.3M 2.3M 0.0k 23.4M 23.4M 0.0k nvme44n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.3M 2.3M 0.0k 22.6M 22.7M 0.0k nvme48n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.2M 2.4M 0.0k 21.7M 23.9M 0.0k nvme4n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.4M 2.4M 0.0k 23.5M 23.6M 0.0k nvme52n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.5M 2.4M 0.0k 24.5M 24.4M 0.0k nvme56n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 2.4M 2.3M 0.0k 24.2M 22.8M 0.0k nvme60n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 2.1M 2.4M 0.0k 21.4M 24.4M 0.0k nvme64n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.2M 2.5M 0.0k 22.3M 24.9M 0.0k nvme8n3 2026-02-18T03:46:11.736 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:12 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/4023514981' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:12 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3909289801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:12 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/39011246' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4023514981' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3909289801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/39011246' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4023514981' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3909289801' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:12.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/39011246' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:13 trial155 ceph-mon[102239]: pgmap v701: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.99k op/s 2026-02-18T03:46:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:13 trial034 ceph-mon[109579]: pgmap v701: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.99k op/s 2026-02-18T03:46:13.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:13 trial086 ceph-mon[98535]: pgmap v701: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.99k op/s 2026-02-18T03:46:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:15 trial155 ceph-mon[102239]: pgmap v702: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.62k op/s 2026-02-18T03:46:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:15 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/2450891916' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:15 trial034 ceph-mon[109579]: pgmap v702: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.62k op/s 2026-02-18T03:46:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:15 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2450891916' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:15.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:15 trial086 ceph-mon[98535]: pgmap v702: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.62k op/s 2026-02-18T03:46:15.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2450891916' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:16 trial155 ceph-mon[102239]: pgmap v703: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.12k op/s 2026-02-18T03:46:16.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:16 trial034 ceph-mon[109579]: pgmap v703: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.12k op/s 2026-02-18T03:46:16.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:16 trial086 ceph-mon[98535]: pgmap v703: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.12k op/s 2026-02-18T03:46:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:18 trial034 ceph-mon[109579]: pgmap v704: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.82k op/s 2026-02-18T03:46:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:18 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4049998670' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:18 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3491339098' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:18 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3471141817' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.326 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:18 trial086 ceph-mon[98535]: pgmap v704: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.82k op/s 2026-02-18T03:46:19.326 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4049998670' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.326 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3491339098' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.327 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3471141817' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:18 trial155 ceph-mon[102239]: pgmap v704: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.82k op/s 2026-02-18T03:46:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:18 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/4049998670' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:18 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3491339098' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:18 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/3471141817' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:21.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:20 trial034 ceph-mon[109579]: pgmap v705: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.63k op/s 2026-02-18T03:46:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:20 trial086 ceph-mon[98535]: pgmap v705: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.63k op/s 2026-02-18T03:46:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:20 trial155 ceph-mon[102239]: pgmap v705: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.63k op/s 2026-02-18T03:46:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.3M 2.3M 0.0k 22.5M 22.9M 0.0k nvme12n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 2.3M 2.2M 0.0k 23.2M 21.6M 0.0k nvme16n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 2.4M 2.2M 0.0k 24.3M 21.7M 0.0k nvme20n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 2.3M 2.3M 0.0k 22.7M 23.0M 0.0k nvme24n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 2.2M 2.4M 0.0k 21.7M 23.7M 0.0k nvme28n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.90 2.1M 2.2M 0.0k 20.5M 22.2M 0.0k nvme32n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 2.1M 2.2M 0.0k 21.0M 22.4M 0.0k nvme36n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 210.10 2.4M 2.2M 0.0k 23.7M 22.4M 0.0k nvme40n3 2026-02-18T03:46:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.40 2.2M 2.2M 0.0k 22.3M 22.3M 0.0k nvme44n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.2M 2.2M 0.0k 22.3M 21.7M 0.0k nvme48n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.3M 2.4M 0.0k 22.9M 23.7M 0.0k nvme4n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.5M 2.3M 0.0k 24.6M 23.4M 0.0k nvme52n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.4M 2.5M 0.0k 24.3M 24.9M 0.0k nvme56n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.50 2.3M 2.3M 0.0k 22.8M 23.3M 0.0k nvme60n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.70 2.3M 2.3M 0.0k 22.9M 22.9M 0.0k nvme64n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 208.40 2.5M 2.3M 0.0k 25.2M 22.7M 0.0k nvme8n3 2026-02-18T03:46:21.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:22 trial034 ceph-mon[109579]: pgmap v706: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.00k op/s 2026-02-18T03:46:23.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:22 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3051717210' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:23 trial086 ceph-mon[98535]: pgmap v706: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.00k op/s 2026-02-18T03:46:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3051717210' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:23 trial155 ceph-mon[102239]: pgmap v706: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.00k op/s 2026-02-18T03:46:23.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:23 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/3051717210' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:25.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:25 trial034 ceph-mon[109579]: pgmap v707: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.63k op/s 2026-02-18T03:46:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:25 trial086 ceph-mon[98535]: pgmap v707: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.63k op/s 2026-02-18T03:46:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:25 trial155 ceph-mon[102239]: pgmap v707: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.63k op/s 2026-02-18T03:46:26.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1623863870' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3618462364' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3488622503' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1623863870' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3618462364' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3488622503' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:26 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1623863870' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:26 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3618462364' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:26.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:26 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/3488622503' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:27.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:27 trial034 ceph-mon[109579]: pgmap v708: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.13k op/s 2026-02-18T03:46:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:27 trial086 ceph-mon[98535]: pgmap v708: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.13k op/s 2026-02-18T03:46:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:27 trial155 ceph-mon[102239]: pgmap v708: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.13k op/s 2026-02-18T03:46:29.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:29 trial034 ceph-mon[109579]: pgmap v709: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 2.82k op/s 2026-02-18T03:46:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:29 trial086 ceph-mon[98535]: pgmap v709: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 2.82k op/s 2026-02-18T03:46:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:29 trial155 ceph-mon[102239]: pgmap v709: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 2.82k op/s 2026-02-18T03:46:30.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3324632111' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3324632111' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:30 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/3324632111' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:31.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:31 trial034 ceph-mon[109579]: pgmap v710: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.63k op/s 2026-02-18T03:46:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:31 trial086 ceph-mon[98535]: pgmap v710: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.63k op/s 2026-02-18T03:46:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:31 trial155 ceph-mon[102239]: pgmap v710: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.63k op/s 2026-02-18T03:46:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:31.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 2.2M 2.3M 0.0k 21.9M 22.5M 0.0k nvme12n3 2026-02-18T03:46:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 2.1M 2.3M 0.0k 21.0M 22.6M 0.0k nvme16n3 2026-02-18T03:46:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 2.2M 2.2M 0.0k 21.7M 21.9M 0.0k nvme20n3 2026-02-18T03:46:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.2M 2.1M 0.0k 22.3M 21.4M 0.0k nvme24n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.3M 2.2M 0.0k 22.5M 21.9M 0.0k nvme28n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 2.0M 2.2M 0.0k 20.3M 21.7M 0.0k nvme32n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.0M 2.2M 0.0k 20.1M 22.1M 0.0k nvme36n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.3M 2.2M 0.0k 22.5M 21.7M 0.0k nvme40n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 208.40 2.4M 2.3M 0.0k 23.6M 22.8M 0.0k nvme44n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.1M 2.1M 0.0k 20.6M 20.7M 0.0k nvme48n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.2M 2.2M 0.0k 21.6M 22.5M 0.0k nvme4n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.4M 2.2M 0.0k 23.8M 22.4M 0.0k nvme52n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.2M 2.3M 0.0k 22.2M 22.8M 0.0k nvme56n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.60 2.3M 2.2M 0.0k 23.1M 22.4M 0.0k nvme60n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.70 2.2M 2.2M 0.0k 22.3M 22.1M 0.0k nvme64n3 2026-02-18T03:46:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.0M 2.3M 0.0k 20.0M 23.2M 0.0k nvme8n3 2026-02-18T03:46:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:33 trial034 ceph-mon[109579]: pgmap v711: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.99k op/s 2026-02-18T03:46:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3332026026' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3045096311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2223151732' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:33 trial086 ceph-mon[98535]: pgmap v711: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.99k op/s 2026-02-18T03:46:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3332026026' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3045096311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2223151732' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:33 trial155 ceph-mon[102239]: pgmap v711: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.99k op/s 2026-02-18T03:46:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:33 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/3332026026' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:33 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3045096311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:33.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:33 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/2223151732' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:35.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:35 trial034 ceph-mon[109579]: pgmap v712: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.61k op/s 2026-02-18T03:46:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:35 trial086 ceph-mon[98535]: pgmap v712: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.61k op/s 2026-02-18T03:46:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:35 trial155 ceph-mon[102239]: pgmap v712: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.61k op/s 2026-02-18T03:46:37.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:37 trial034 ceph-mon[109579]: pgmap v713: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:46:37.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1243307013' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:37 trial086 ceph-mon[98535]: pgmap v713: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:46:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1243307013' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:37 trial155 ceph-mon[102239]: pgmap v713: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 3.11k op/s 2026-02-18T03:46:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:37 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1243307013' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:39.280 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:39 trial155 ceph-mon[102239]: pgmap v714: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.82k op/s 2026-02-18T03:46:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:39 trial086 ceph-mon[98535]: pgmap v714: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.82k op/s 2026-02-18T03:46:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:39 trial034 ceph-mon[109579]: pgmap v714: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.82k op/s 2026-02-18T03:46:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1271274591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4270598384' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3843760530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:40 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1271274591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:40 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/4270598384' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:40 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/3843760530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1271274591' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4270598384' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3843760530' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:41 trial086 ceph-mon[98535]: pgmap v715: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.63k op/s 2026-02-18T03:46:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:41 trial034 ceph-mon[109579]: pgmap v715: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.63k op/s 2026-02-18T03:46:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:41 trial155 ceph-mon[102239]: pgmap v715: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.63k op/s 2026-02-18T03:46:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 210.20 2.3M 2.2M 0.0k 23.0M 21.9M 0.0k nvme12n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.1M 2.1M 0.0k 20.7M 20.8M 0.0k nvme16n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.50 2.1M 2.2M 0.0k 20.9M 21.9M 0.0k nvme20n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.1M 2.1M 0.0k 21.4M 21.1M 0.0k nvme24n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.1M 2.1M 0.0k 21.2M 21.4M 0.0k nvme28n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 1.9M 2.1M 0.0k 19.4M 21.0M 0.0k nvme32n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.1M 2.1M 0.0k 21.4M 21.5M 0.0k nvme36n3 2026-02-18T03:46:41.738 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 2.1M 2.1M 0.0k 20.5M 20.9M 0.0k nvme40n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.1M 2.2M 0.0k 21.2M 21.9M 0.0k nvme44n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.1M 2.1M 0.0k 20.8M 21.0M 0.0k nvme48n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.2M 2.2M 0.0k 22.1M 22.0M 0.0k nvme4n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.1M 2.2M 0.0k 21.4M 22.4M 0.0k nvme52n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.20 2.2M 2.2M 0.0k 22.5M 22.0M 0.0k nvme56n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.2M 2.2M 0.0k 21.8M 22.1M 0.0k nvme60n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.2M 2.1M 0.0k 21.7M 21.3M 0.0k nvme64n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.2M 2.2M 0.0k 21.7M 22.4M 0.0k nvme8n3 2026-02-18T03:46:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:43 trial086 ceph-mon[98535]: pgmap v716: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.00k op/s 2026-02-18T03:46:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:43 trial155 ceph-mon[102239]: pgmap v716: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.00k op/s 2026-02-18T03:46:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:43 trial034 ceph-mon[109579]: pgmap v716: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.00k op/s 2026-02-18T03:46:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1306931353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:44 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1306931353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1306931353' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:45 trial086 ceph-mon[98535]: pgmap v717: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.64k op/s 2026-02-18T03:46:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:45 trial155 ceph-mon[102239]: pgmap v717: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.64k op/s 2026-02-18T03:46:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:45 trial034 ceph-mon[109579]: pgmap v717: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 3.64k op/s 2026-02-18T03:46:46.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:46:46.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:46:46.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:46 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:46:46.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:46 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:46:46.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:46:46.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:46 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:46:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:47 trial086 ceph-mon[98535]: Adjusting osd_memory_target on trial034 to 39975M 2026-02-18T03:46:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:47 trial086 ceph-mon[98535]: pgmap v718: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.15k op/s 2026-02-18T03:46:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1366625953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/208309333' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1194247898' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:47 trial155 ceph-mon[102239]: Adjusting osd_memory_target on trial034 to 39975M 2026-02-18T03:46:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:47 trial155 ceph-mon[102239]: pgmap v718: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.15k op/s 2026-02-18T03:46:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:47 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/1366625953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:47 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/208309333' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:47 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1194247898' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:47 trial034 ceph-mon[109579]: Adjusting osd_memory_target on trial034 to 39975M 2026-02-18T03:46:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:47 trial034 ceph-mon[109579]: pgmap v718: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.15k op/s 2026-02-18T03:46:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1366625953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/208309333' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1194247898' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:48.031 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:46:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:49 trial086 ceph-mon[98535]: pgmap v719: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.85k op/s 2026-02-18T03:46:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:49 trial155 ceph-mon[102239]: pgmap v719: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.85k op/s 2026-02-18T03:46:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:49 trial034 ceph-mon[109579]: pgmap v719: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 2.85k op/s 2026-02-18T03:46:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:51 trial086 ceph-mon[98535]: pgmap v720: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.65k op/s 2026-02-18T03:46:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/973158258' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:51 trial155 ceph-mon[102239]: pgmap v720: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.65k op/s 2026-02-18T03:46:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:51 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/973158258' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:51 trial034 ceph-mon[109579]: pgmap v720: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.65k op/s 2026-02-18T03:46:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/973158258' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 2.0M 2.1M 0.0k 20.3M 21.1M 0.0k nvme12n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 1.9M 2.1M 0.0k 19.1M 21.5M 0.0k nvme16n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.0M 2.0M 0.0k 20.2M 20.4M 0.0k nvme20n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.0M 2.1M 0.0k 20.0M 21.2M 0.0k nvme24n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.1M 2.1M 0.0k 21.1M 20.9M 0.0k nvme28n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 2.0M 2.0M 0.0k 20.2M 20.5M 0.0k nvme32n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.2M 2.1M 0.0k 21.8M 21.3M 0.0k nvme36n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 2.2M 2.1M 0.0k 21.7M 21.0M 0.0k nvme40n3 2026-02-18T03:46:51.736 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.0M 2.1M 0.0k 20.1M 21.3M 0.0k nvme44n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 197.10 1.9M 2.1M 0.0k 19.0M 21.3M 0.0k nvme48n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 208.20 2.3M 2.0M 0.0k 22.6M 20.5M 0.0k nvme4n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 2.2M 2.1M 0.0k 22.1M 21.1M 0.0k nvme52n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.1M 2.2M 0.0k 21.3M 22.3M 0.0k nvme56n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.1M 2.2M 0.0k 20.9M 21.5M 0.0k nvme60n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 196.90 2.0M 2.1M 0.0k 20.3M 20.6M 0.0k nvme64n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 208.60 2.2M 2.1M 0.0k 22.0M 20.8M 0.0k nvme8n3 2026-02-18T03:46:51.737 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:46:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:53 trial086 ceph-mon[98535]: pgmap v721: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.01k op/s 2026-02-18T03:46:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:53 trial155 ceph-mon[102239]: pgmap v721: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.01k op/s 2026-02-18T03:46:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:53 trial034 ceph-mon[109579]: pgmap v721: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.01k op/s 2026-02-18T03:46:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/527878692' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3313206600' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1379219265' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:54 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/527878692' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:54 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/3313206600' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:54 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1379219265' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/527878692' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3313206600' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1379219265' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:55 trial086 ceph-mon[98535]: pgmap v722: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.64k op/s 2026-02-18T03:46:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:55 trial155 ceph-mon[102239]: pgmap v722: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.64k op/s 2026-02-18T03:46:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:55 trial034 ceph-mon[109579]: pgmap v722: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 3.64k op/s 2026-02-18T03:46:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:57 trial086 ceph-mon[98535]: pgmap v723: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:46:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:57 trial155 ceph-mon[102239]: pgmap v723: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:46:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:57 trial034 ceph-mon[109579]: pgmap v723: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.13k op/s 2026-02-18T03:46:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1733937393' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:58 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/1733937393' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1733937393' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:46:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:46:59 trial086 ceph-mon[98535]: pgmap v724: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.83k op/s 2026-02-18T03:46:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:46:59 trial155 ceph-mon[102239]: pgmap v724: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.83k op/s 2026-02-18T03:46:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:46:59 trial034 ceph-mon[109579]: pgmap v724: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.83k op/s 2026-02-18T03:47:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:01 trial086 ceph-mon[98535]: pgmap v725: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.62k op/s 2026-02-18T03:47:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/949914158' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2313948529' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3957457936' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:01 trial155 ceph-mon[102239]: pgmap v725: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.62k op/s 2026-02-18T03:47:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:01 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/949914158' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:01 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2313948529' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:01 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/3957457936' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:01 trial034 ceph-mon[109579]: pgmap v725: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.62k op/s 2026-02-18T03:47:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/949914158' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2313948529' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3957457936' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:01.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.10 1.9M 2.0M 0.0k 18.8M 20.2M 0.0k nvme12n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.00 2.1M 2.1M 0.0k 21.1M 20.7M 0.0k nvme16n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.90 1.9M 2.0M 0.0k 19.1M 20.4M 0.0k nvme20n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 1.9M 2.1M 0.0k 18.9M 21.3M 0.0k nvme24n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.0M 1.9M 0.0k 19.7M 19.5M 0.0k nvme28n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 1.9M 1.9M 0.0k 18.5M 19.3M 0.0k nvme32n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.0M 2.0M 0.0k 20.3M 20.2M 0.0k nvme36n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 191.60 1.9M 1.9M 0.0k 18.7M 19.5M 0.0k nvme40n3 2026-02-18T03:47:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.80 2.0M 2.1M 0.0k 20.5M 20.6M 0.0k nvme44n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 2.0M 2.0M 0.0k 20.0M 20.3M 0.0k nvme48n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 204.30 2.1M 2.0M 0.0k 20.9M 20.3M 0.0k nvme4n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 1.9M 2.1M 0.0k 18.8M 20.6M 0.0k nvme52n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 2.0M 2.1M 0.0k 20.2M 21.0M 0.0k nvme56n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 2.0M 2.0M 0.0k 20.3M 20.3M 0.0k nvme60n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.1M 2.1M 0.0k 21.3M 20.7M 0.0k nvme64n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 2.1M 2.0M 0.0k 20.9M 19.5M 0.0k nvme8n3 2026-02-18T03:47:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:03 trial086 ceph-mon[98535]: pgmap v726: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.98k op/s 2026-02-18T03:47:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:03 trial155 ceph-mon[102239]: pgmap v726: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.98k op/s 2026-02-18T03:47:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:03 trial034 ceph-mon[109579]: pgmap v726: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 31 MiB/s wr, 2.98k op/s 2026-02-18T03:47:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:05 trial086 ceph-mon[98535]: pgmap v727: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.60k op/s 2026-02-18T03:47:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3466646501' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:05 trial155 ceph-mon[102239]: pgmap v727: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.60k op/s 2026-02-18T03:47:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:05 trial155 ceph-mon[102239]: from='client.? 10.20.193.155:0/3466646501' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:05 trial034 ceph-mon[109579]: pgmap v727: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.60k op/s 2026-02-18T03:47:05.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3466646501' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:05.980 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:47:05.980 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:47:05.981 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:35:52 UTC; 11min ago 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (conmon) 2026-02-18T03:47:06.009 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 378.6M (peak: 381.8M) 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 44min 57.560s 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94658 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94677 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─94773 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─95106 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: │ └─95111 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.010 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout: └─94656 /usr/bin/conmon --api-version 1 -c 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -u 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata -p /run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: states { 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: grp_id: 3 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: state: INACCESSIBLE 2026-02-18T03:47:06.011 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: } 2026-02-18T03:47:06.012 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:44:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: ], , client address: IPv4 10.20.193.34:54432 2026-02-18T03:47:06.013 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 7min ago 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:47:06.040 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 353.8M (peak: 357.1M) 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 28min 40.514s 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.041 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185440] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185452] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185800] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.185817] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186164] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186179] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186529] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186554] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:47:06.042 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186894] bdev_rbd.c:2013:rbd_bdev_check_epoch: *NOTICE*: Failed to get metadata key = reservation_key 2026-02-18T03:47:06.043 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:44:19 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:44:19.186919] bdev_rbd.c: 145:_rbd_update_callback: *NOTICE*: failed to notify reservation change. 2026-02-18T03:47:06.044 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:47:06.081 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:44:19 UTC; 2min 46s ago 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91482 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91483 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 91554 (conmon) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 335.0M (peak: 336.8M) 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 10min 56.305s 2026-02-18T03:47:06.082 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91556 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91558 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91650 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─92256 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: │ └─92321 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: └─91554 /usr/bin/conmon --api-version 1 -c 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -u 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata -p /run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:47:06.083 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:47:06.084 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.718844] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000304 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.730690] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000322 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.746717] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000332 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.762675] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000322 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.778705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000343 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.794719] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000331 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.810664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000283 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.826721] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000335 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.842646] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000267 seconds 2026-02-18T03:47:06.085 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.858687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000281 seconds 2026-02-18T03:47:06.086 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:47:06.114 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 4min 23s ago 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 366.1M (peak: 371.2M) 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 18min 238ms 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:47:06.115 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:47:06.116 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:47:06.342 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:47:06.342 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 9m ago 22m trial034=x;count:1 2026-02-18T03:47:06.342 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 9m ago 22m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:47:06.342 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 9m ago 20m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:47:06.343 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 9m ago 21m trial155 2026-02-18T03:47:06.352 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:47:06.538 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:47:06.538 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (11m) 9m ago 11m 330M - 1.6.5 99a57256b38c 63cbb06c444f 2026-02-18T03:47:06.538 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (7m) 7m ago 11m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:47:06.538 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (2m) 81s ago 2m 330M - 1.6.5 99a57256b38c 6656e6ed9326 2026-02-18T03:47:06.538 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (4m) 4m ago 11m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:47:06.547 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:47:06.765 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:47:06.774 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:47:06.991 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:47:06.991 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:06.991 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:47:06.991 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 81s) [leader: a] 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 22m) 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 20m), 8 in (since 21m) 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: usage: 53 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: client: 31 MiB/s rd, 31 MiB/s wr, 1.53k op/s rd, 1.56k op/s wr 2026-02-18T03:47:06.992 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:47:07.001 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 215, 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 4, 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 145, 2026-02-18T03:47:07.233 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:47:07.234 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:47:07.243 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:47:07.302 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.303 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.304 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:47:07.305 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:47:07.349 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.351 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:47:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:07 trial086 ceph-mon[98535]: pgmap v728: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.09k op/s 2026-02-18T03:47:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:07 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4228824869' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:47:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:07 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2305240244' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:47:07.397 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.397 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:47:07.442 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.442 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:47:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:07 trial155 ceph-mon[102239]: pgmap v728: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.09k op/s 2026-02-18T03:47:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:07 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/4228824869' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:47:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:07 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2305240244' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:47:07.486 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.486 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:47:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:07 trial034 ceph-mon[109579]: pgmap v728: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.09k op/s 2026-02-18T03:47:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:07 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4228824869' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:47:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:07 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2305240244' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:47:07.530 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.530 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:47:07.575 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.575 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:47:07.620 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.621 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:47:07.705 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.705 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:47:07.749 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.749 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:47:07.793 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.794 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:47:07.836 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.837 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:47:07.921 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.921 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:47:07.965 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:07.966 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:47:08.011 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.012 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:47:08.057 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.058 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:47:08.102 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.103 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:47:08.187 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.188 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:47:08.234 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.235 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:47:08.280 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.281 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:47:08.326 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.327 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:47:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.108272 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.108278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1509423874' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:47:08.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2258689914' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2893532988' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1128423273' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.379 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.379 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:47:08.450 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.451 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:47:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.108272 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.108278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/1509423874' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:47:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.? 10.20.193.86:0/2258689914' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.? 10.20.193.177:0/2893532988' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:08 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/1128423273' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.108272 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.108278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1509423874' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2258689914' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2893532988' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:08 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1128423273' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:08.544 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.546 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:47:08.590 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.592 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:47:08.637 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.637 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:47:08.682 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.683 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:47:08.728 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.729 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:47:08.774 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.774 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:47:08.858 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.859 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:47:08.944 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:08.944 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:47:09.029 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.030 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:47:09.075 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.076 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:47:09.120 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.121 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:47:09.165 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.167 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:47:09.210 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.211 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:47:09.256 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.257 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:47:09.300 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.302 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:47:09.347 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.348 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:47:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:09 trial086 ceph-mon[98535]: pgmap v729: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 2.79k op/s 2026-02-18T03:47:09.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:09 trial155 ceph-mon[102239]: pgmap v729: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 2.79k op/s 2026-02-18T03:47:09.392 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.393 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:47:09.479 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.480 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:47:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:09 trial034 ceph-mon[109579]: pgmap v729: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 28 MiB/s wr, 2.79k op/s 2026-02-18T03:47:09.524 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.525 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:47:09.570 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.571 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:47:09.616 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.617 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:47:09.662 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.663 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:47:09.706 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.707 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:47:09.751 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.753 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:47:09.798 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.798 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:47:09.842 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.843 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:47:09.929 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.929 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:47:09.973 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:09.974 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:47:10.017 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.018 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:47:10.063 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.064 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:47:10.107 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.109 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:47:10.154 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.155 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:47:10.200 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.201 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:47:10.245 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.246 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:47:10.291 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.292 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:47:10.335 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.337 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:47:10.380 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.382 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:47:10.425 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.426 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:47:10.471 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.472 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:47:10.515 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.516 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:47:10.601 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.602 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:47:10.646 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:47:10.647 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:47:10.647 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:47:10.648 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.a 2026-02-18T03:47:10.648 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon stop nvmeof.nvmeof.a 2026-02-18T03:47:10.648 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:47:10.648 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:47:10.648 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:47:10.866 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to stop nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:47:10.876 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:47:10.876 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:47:10.876 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:47:10.876 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 85 secs before reviving 2026-02-18T03:47:10.901 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":85,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:47:10.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:47:10.912 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:47:10.913 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:47:10.913 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 268443, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 85, 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.031 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.032 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.033 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.034 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: "num": 40 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:47:11.035 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:47:11.039 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:47:11.039 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:47:11.039 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:47:11.120 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:47:11.120 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:11.120 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:11.120 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:47:11.120 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 439179, 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 86, 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:47:11.121 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.122 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.123 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:47:11.124 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.125 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.126 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.127 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.128 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.129 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.130 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.131 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.132 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.133 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "num": 106 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.134 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: "num": 3 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:47:11.135 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:47:11.137 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:47:11.137 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:47:11.137 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 50, 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 87215, 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:47:11.222 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 86, 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.223 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:47:11.224 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.225 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:47:11.226 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:11.227 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:47:11.228 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:47:11.229 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:11.230 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.231 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:11.232 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.233 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.234 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:11.235 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:11.236 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:47:11.236 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:47:11.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:11 trial034 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:47:11.236 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:11] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:47:11.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:11] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:47:11.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:11] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.34:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.34:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:47:11.237 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:11] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:47:11.237 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: pgmap v730: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.61k op/s 2026-02-18T03:47:11.237 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.237 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.237 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/917749248' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:11.238 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:11 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:11.239 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:47:11.239 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['c'] 2026-02-18T03:47:11.240 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:47:11.240 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.c 2026-02-18T03:47:11.240 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.c 2026-02-18T03:47:11.240 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:47:11.240 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:47:11.356 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: pgmap v730: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.61k op/s 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='client.? 10.20.193.34:0/917749248' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:11.357 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:11.358 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 ceph-mon[102239]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:11.358 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:47:11 trial155 systemd[1]: Stopping Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: pgmap v730: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 3.61k op/s 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:47:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:11.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:47:11.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/917749248' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:11.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:11.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:11 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:11.473 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service' 2026-02-18T03:47:11.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:47:11.517 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:47:11.517 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:47:11.517 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:47:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.10 2.1M 2.0M 0.0k 21.1M 19.9M 0.0k nvme12n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.0M 2.0M 0.0k 20.4M 20.4M 0.0k nvme16n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.1M 2.0M 0.0k 21.2M 20.4M 0.0k nvme20n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.70 1.9M 1.9M 0.0k 19.3M 19.1M 0.0k nvme24n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.1M 1.9M 0.0k 20.9M 19.1M 0.0k nvme28n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 1.9M 2.0M 0.0k 19.3M 19.5M 0.0k nvme32n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 1.9M 2.0M 0.0k 19.3M 19.6M 0.0k nvme36n3 2026-02-18T03:47:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.50 1.9M 2.0M 0.0k 19.5M 20.1M 0.0k nvme40n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 1.9M 2.0M 0.0k 19.2M 19.6M 0.0k nvme44n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 1.8M 2.0M 0.0k 18.2M 20.1M 0.0k nvme48n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.0M 2.1M 0.0k 20.0M 20.5M 0.0k nvme4n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.0M 2.0M 0.0k 19.7M 20.3M 0.0k nvme52n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 2.0M 2.0M 0.0k 19.5M 19.9M 0.0k nvme56n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 193.70 2.0M 1.9M 0.0k 19.7M 19.2M 0.0k nvme60n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.80 2.1M 2.0M 0.0k 21.4M 20.2M 0.0k nvme64n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 198.70 2.0M 2.0M 0.0k 19.8M 19.6M 0.0k nvme8n3 2026-02-18T03:47:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:11.760 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":86,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:47:13.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:13] WARNING state.py:1293 (2): Server is going down, stop updates 2026-02-18T03:47:14.772 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:47:15.019 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":89,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:47:15.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:14] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:47:15.049 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:14] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:47:15.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:14] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:47:15.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:14] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial034) 2026-02-18T03:47:15.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:47:15.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:47:15.050 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:47:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:47:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 podman[112985]: 2026-02-18 03:47:15.072715043 +0000 UTC m=+3.911751387 container died 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.spdk.build.makeflags=, maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, release=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.6.5, distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, architecture=x86_64, vendor=Red Hat, Inc., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.maintainer=Ceph Developers , io.ceph.git.branch=devel, vcs-type=git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.pkgdep-args=--rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:47:15.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 podman[112985]: 2026-02-18 03:47:15.084528954 +0000 UTC m=+3.923565298 container remove 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.ceph-release=20.2.0, build-date=2026-02-11 09:53:49 UTC, io.ceph.version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.version=9.0-30.el9, io.ceph.git.branch=devel, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, com.redhat.component=ubi9-container, distribution-scope=public, io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, io.openshift.wants=ceph,rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, release=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.nvmeof=, maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined) 2026-02-18T03:47:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 bash[112985]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:47:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:47:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:47:15.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 45min 29.723s CPU time, 381.8M memory peak. 2026-02-18T03:47:18.032 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:47:18.272 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":93,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:47:21.286 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:47:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 1.9M 2.0M 0.0k 19.2M 20.1M 0.0k nvme12n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 208.80 2.0M 1.9M 0.0k 20.2M 19.1M 0.0k nvme16n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 1.8M 1.9M 0.0k 18.4M 18.6M 0.0k nvme20n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 1.9M 2.0M 0.0k 18.9M 19.5M 0.0k nvme24n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 2.1M 1.9M 0.0k 21.2M 18.5M 0.0k nvme28n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 1.8M 1.8M 0.0k 18.2M 18.4M 0.0k nvme32n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 1.8M 1.8M 0.0k 17.9M 18.5M 0.0k nvme36n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.90 2.1M 2.0M 0.0k 21.0M 19.6M 0.0k nvme40n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 2.0M 1.9M 0.0k 19.8M 19.1M 0.0k nvme44n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.10 1.7M 1.8M 0.0k 16.9M 18.3M 0.0k nvme48n3 2026-02-18T03:47:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 1.8M 1.9M 0.0k 18.0M 19.2M 0.0k nvme4n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.0M 2.0M 0.0k 19.7M 19.9M 0.0k nvme52n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.00 1.9M 2.0M 0.0k 19.2M 20.0M 0.0k nvme56n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 2.0M 1.9M 0.0k 20.4M 19.1M 0.0k nvme60n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.10 1.9M 1.9M 0.0k 19.4M 19.4M 0.0k nvme64n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.30 2.0M 1.8M 0.0k 19.6M 18.5M 0.0k nvme8n3 2026-02-18T03:47:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v731: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 2.98k op/s 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v732: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.62k op/s 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3119255583' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/756371449' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3381182816' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v733: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.14k op/s 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v734: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.86k op/s 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2367364973' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3430229551' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v735: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.70k op/s 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v736: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 3.05k op/s 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v737: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.52k op/s 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: pgmap v738: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.18k op/s 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:47:27.375 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 22m) 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.376 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.377 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v731: 33 pgs: 33 active+clean; 16 GiB data, 53 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 30 MiB/s wr, 2.98k op/s 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v732: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 36 MiB/s wr, 3.62k op/s 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3119255583' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/756371449' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3381182816' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v733: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.14k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v734: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.86k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2367364973' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3430229551' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v735: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.70k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: mon.b calling monitor election 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v736: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 3.05k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v737: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.52k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: pgmap v738: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 30 MiB/s rd, 30 MiB/s wr, 3.18k op/s 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:47:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: monmap epoch 3 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: min_mon_release 20 (tentacle) 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: election_strategy: 1 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: fsmap 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: osdmap e59: 8 total, 8 up, 8 in 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: mgrmap e15: x(active, since 22m) 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2026-02-18T03:47:27.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:47:27.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:47:27.527 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":54,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:47:27.539 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:47:27.540 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon a 2026-02-18T03:47:27.540 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:47:27.620 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:47:27.620 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:27.620 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:27.620 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 54, 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 285032, 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:47:27.621 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.622 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.623 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:47:27.624 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.625 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.626 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:47:27.627 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.628 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.629 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.630 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.631 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.632 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.633 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout: "num": 39 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:47:27.634 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:47:27.635 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:47:27.635 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:47:27.636 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 54, 2026-02-18T03:47:27.713 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 455772, 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.714 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:47:27.715 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.716 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:47:27.717 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:47:27.718 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:47:27.719 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.720 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.721 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.722 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:47:27.723 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.724 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.725 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.726 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "num": 73 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:47:27.727 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:47:27.728 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:47:27.728 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:47:27.729 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:47:27.729 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:47:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:28 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1836154538' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:28.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:28 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:28 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:28 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:28.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:28 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:28 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1836154538' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:47:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:28 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:28 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:28 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:47:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:28 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:47:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:29 trial086 ceph-mon[98535]: pgmap v739: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.87k op/s 2026-02-18T03:47:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:29 trial034 ceph-mon[109579]: pgmap v739: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.87k op/s 2026-02-18T03:47:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:31 trial086 ceph-mon[98535]: pgmap v740: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.69k op/s 2026-02-18T03:47:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:31 trial034 ceph-mon[109579]: pgmap v740: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.69k op/s 2026-02-18T03:47:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:31.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 1.9M 1.9M 0.0k 18.9M 18.7M 0.0k nvme12n3 2026-02-18T03:47:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.80 1.9M 1.9M 0.0k 19.0M 19.0M 0.0k nvme16n3 2026-02-18T03:47:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 203.10 2.0M 1.8M 0.0k 19.7M 18.5M 0.0k nvme20n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 1.9M 1.9M 0.0k 19.4M 18.8M 0.0k nvme24n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.30 2.1M 1.9M 0.0k 20.8M 19.3M 0.0k nvme28n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 219.00 2.0M 2.0M 0.0k 20.3M 20.3M 0.0k nvme32n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 1.9M 1.8M 0.0k 18.9M 18.0M 0.0k nvme36n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 1.8M 1.9M 0.0k 18.0M 19.4M 0.0k nvme40n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 1.9M 2.0M 0.0k 19.1M 20.0M 0.0k nvme44n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.50 1.9M 1.9M 0.0k 19.1M 18.7M 0.0k nvme48n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.90 2.0M 1.9M 0.0k 19.8M 19.0M 0.0k nvme4n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 1.9M 1.9M 0.0k 18.5M 19.3M 0.0k nvme52n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.0M 2.0M 0.0k 20.3M 19.8M 0.0k nvme56n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.80 2.0M 1.9M 0.0k 19.9M 18.6M 0.0k nvme60n3 2026-02-18T03:47:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.0M 1.9M 0.0k 20.4M 19.2M 0.0k nvme64n3 2026-02-18T03:47:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 1.8M 2.0M 0.0k 18.4M 19.6M 0.0k nvme8n3 2026-02-18T03:47:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:33 trial086 ceph-mon[98535]: pgmap v741: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 29 MiB/s wr, 3.03k op/s 2026-02-18T03:47:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:33 trial034 ceph-mon[109579]: pgmap v741: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 28 MiB/s rd, 29 MiB/s wr, 3.03k op/s 2026-02-18T03:47:34.355 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2611208771' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.355 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4220051722' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.355 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4229275951' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.355 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-mon[98535]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:47:34.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:47:34] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:47:34.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.357 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:47:34.359 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.360 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:47:34.361 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.362 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:47:34.363 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49526 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.110343] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000214 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.126365] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000273 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.146338] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000245 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.162392] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000284 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.178353] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000247 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.202390] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000277 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.218420] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000292 seconds 2026-02-18T03:47:34.364 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.234421] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000297 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.250398] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000291 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.266411] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000321 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.282379] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000265 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.298292] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000189 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.314323] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000222 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.338445] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000290 seconds 2026-02-18T03:47:34.365 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.354316] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000199 seconds 2026-02-18T03:47:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2611208771' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4220051722' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:34 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4229275951' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:34.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:34 trial034 ceph-mon[109579]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:47:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:35 trial086 ceph-mon[98535]: pgmap v743: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:35 trial086 ceph-mon[98535]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:47:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:35 trial034 ceph-mon[109579]: pgmap v743: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:35 trial034 ceph-mon[109579]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:47:36.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:36 trial086 ceph-mon[98535]: pgmap v744: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:36.770 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:36 trial034 ceph-mon[109579]: pgmap v744: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:39 trial034 ceph-mon[109579]: pgmap v745: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:39 trial086 ceph-mon[98535]: pgmap v745: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.29k op/s 2026-02-18T03:47:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:41 trial034 ceph-mon[109579]: pgmap v746: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.27k op/s 2026-02-18T03:47:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/935744079' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1173696471' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3658308651' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:41 trial086 ceph-mon[98535]: pgmap v746: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.27k op/s 2026-02-18T03:47:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/935744079' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1173696471' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3658308651' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:41.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 1.7M 1.8M 0.0k 16.9M 18.4M 0.0k nvme12n3 2026-02-18T03:47:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.70 1.8M 1.9M 0.0k 18.3M 18.8M 0.0k nvme16n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 1.7M 1.9M 0.0k 16.8M 18.6M 0.0k nvme20n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.40 1.9M 1.8M 0.0k 19.1M 17.8M 0.0k nvme24n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 1.9M 1.8M 0.0k 18.7M 18.5M 0.0k nvme28n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 3.1M 3.2M 0.0k 30.9M 31.7M 0.0k nvme32n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.70 1.9M 1.7M 0.0k 19.0M 17.2M 0.0k nvme36n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 1.8M 1.8M 0.0k 18.2M 17.9M 0.0k nvme40n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 1.8M 1.9M 0.0k 18.3M 18.6M 0.0k nvme44n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 208.00 1.8M 1.9M 0.0k 18.3M 18.8M 0.0k nvme48n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 209.10 1.9M 1.9M 0.0k 19.3M 19.0M 0.0k nvme4n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.20 2.1M 1.9M 0.0k 20.7M 19.1M 0.0k nvme52n3 2026-02-18T03:47:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 1.8M 2.0M 0.0k 17.7M 19.6M 0.0k nvme56n3 2026-02-18T03:47:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 198.00 1.9M 1.8M 0.0k 19.2M 17.9M 0.0k nvme60n3 2026-02-18T03:47:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 191.90 1.6M 1.9M 0.0k 16.2M 19.3M 0.0k nvme64n3 2026-02-18T03:47:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 1.8M 2.0M 0.0k 17.9M 19.7M 0.0k nvme8n3 2026-02-18T03:47:41.742 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:43.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:43 trial034 ceph-mon[109579]: pgmap v747: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.27k op/s 2026-02-18T03:47:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:43 trial086 ceph-mon[98535]: pgmap v747: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 3.27k op/s 2026-02-18T03:47:45.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:45 trial034 ceph-mon[109579]: pgmap v748: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.42k op/s 2026-02-18T03:47:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:45 trial086 ceph-mon[98535]: pgmap v748: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 32 MiB/s wr, 3.42k op/s 2026-02-18T03:47:47.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:47 trial034 ceph-mon[109579]: pgmap v749: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.31k op/s 2026-02-18T03:47:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:47 trial086 ceph-mon[98535]: pgmap v749: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 3.31k op/s 2026-02-18T03:47:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/915471340' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1618336788' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/237350550' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/915471340' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1618336788' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:48.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:48 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/237350550' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:49 trial086 ceph-mon[98535]: pgmap v750: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.83k op/s 2026-02-18T03:47:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:49 trial034 ceph-mon[109579]: pgmap v750: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 27 MiB/s rd, 27 MiB/s wr, 2.83k op/s 2026-02-18T03:47:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:51 trial086 ceph-mon[98535]: pgmap v751: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.65k op/s 2026-02-18T03:47:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:51 trial034 ceph-mon[109579]: pgmap v751: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.65k op/s 2026-02-18T03:47:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:51.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:47:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 215.60 1.8M 1.9M 0.0k 18.2M 19.1M 0.0k nvme12n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.70 1.8M 1.8M 0.0k 17.5M 17.5M 0.0k nvme16n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 1.8M 1.8M 0.0k 17.8M 18.5M 0.0k nvme20n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 1.8M 1.8M 0.0k 18.4M 18.1M 0.0k nvme24n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.60 1.8M 1.7M 0.0k 18.1M 17.2M 0.0k nvme28n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 3.2M 3.2M 0.0k 31.6M 32.4M 0.0k nvme32n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 1.9M 1.9M 0.0k 18.6M 18.7M 0.0k nvme36n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 210.90 2.2M 2.3M 0.0k 22.3M 23.4M 0.0k nvme40n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 2.0M 1.8M 0.0k 20.3M 18.0M 0.0k nvme44n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.70 3.1M 3.1M 0.0k 30.8M 30.7M 0.0k nvme48n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 1.8M 1.8M 0.0k 18.4M 17.7M 0.0k nvme4n3 2026-02-18T03:47:51.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 1.9M 1.8M 0.0k 19.1M 18.0M 0.0k nvme52n3 2026-02-18T03:47:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 194.80 1.7M 1.7M 0.0k 17.4M 17.3M 0.0k nvme56n3 2026-02-18T03:47:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.40 1.9M 1.8M 0.0k 18.6M 18.5M 0.0k nvme60n3 2026-02-18T03:47:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 1.8M 1.8M 0.0k 18.0M 17.8M 0.0k nvme64n3 2026-02-18T03:47:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 1.7M 1.8M 0.0k 17.3M 18.5M 0.0k nvme8n3 2026-02-18T03:47:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:47:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:53 trial086 ceph-mon[98535]: pgmap v752: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.02k op/s 2026-02-18T03:47:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:53 trial034 ceph-mon[109579]: pgmap v752: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.02k op/s 2026-02-18T03:47:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:55 trial086 ceph-mon[98535]: pgmap v753: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.49k op/s 2026-02-18T03:47:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3534000380' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3591518493' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:55.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4075057830' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:55 trial034 ceph-mon[109579]: pgmap v753: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.49k op/s 2026-02-18T03:47:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3534000380' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3591518493' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:55 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/4075057830' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:47:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:57 trial086 ceph-mon[98535]: pgmap v754: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:47:57.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:57 trial034 ceph-mon[109579]: pgmap v754: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:47:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:47:59 trial086 ceph-mon[98535]: pgmap v755: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.85k op/s 2026-02-18T03:47:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:47:59 trial034 ceph-mon[109579]: pgmap v755: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.85k op/s 2026-02-18T03:48:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:01 trial086 ceph-mon[98535]: pgmap v756: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.69k op/s 2026-02-18T03:48:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:01 trial034 ceph-mon[109579]: pgmap v756: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.69k op/s 2026-02-18T03:48:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:01.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 3.1M 3.0M 0.0k 30.7M 29.8M 0.0k nvme12n3 2026-02-18T03:48:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 209.00 2.7M 2.6M 0.0k 26.7M 26.5M 0.0k nvme16n3 2026-02-18T03:48:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.40 3.2M 3.0M 0.0k 32.4M 30.2M 0.0k nvme20n3 2026-02-18T03:48:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 1.7M 1.9M 0.0k 17.3M 18.5M 0.0k nvme24n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 207.80 2.1M 2.3M 0.0k 21.2M 23.4M 0.0k nvme28n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 3.0M 3.0M 0.0k 30.5M 30.1M 0.0k nvme32n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.60 3.2M 3.0M 0.0k 31.9M 29.8M 0.0k nvme36n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.30 3.3M 3.3M 0.0k 32.5M 33.4M 0.0k nvme40n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.4M 2.4M 0.0k 23.7M 23.5M 0.0k nvme44n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.30 3.0M 3.2M 0.0k 30.1M 32.4M 0.0k nvme48n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.6M 2.5M 0.0k 25.9M 24.9M 0.0k nvme4n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 1.8M 1.7M 0.0k 17.7M 17.0M 0.0k nvme52n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 1.9M 1.7M 0.0k 18.9M 16.9M 0.0k nvme56n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 211.00 1.9M 1.8M 0.0k 19.1M 17.8M 0.0k nvme60n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 2.0M 1.8M 0.0k 19.6M 17.7M 0.0k nvme64n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 205.00 2.5M 2.4M 0.0k 25.3M 24.3M 0.0k nvme8n3 2026-02-18T03:48:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2214237185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2753200777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2296096577' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2214237185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2753200777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:02.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:02 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2296096577' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:03 trial086 ceph-mon[98535]: pgmap v757: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 33 MiB/s wr, 3.04k op/s 2026-02-18T03:48:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:03 trial034 ceph-mon[109579]: pgmap v757: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 33 MiB/s wr, 3.04k op/s 2026-02-18T03:48:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:05 trial086 ceph-mon[98535]: pgmap v758: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 41 MiB/s wr, 3.52k op/s 2026-02-18T03:48:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:05 trial034 ceph-mon[109579]: pgmap v758: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 41 MiB/s wr, 3.52k op/s 2026-02-18T03:48:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:07 trial086 ceph-mon[98535]: pgmap v759: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.35k op/s 2026-02-18T03:48:07.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:07 trial034 ceph-mon[109579]: pgmap v759: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.35k op/s 2026-02-18T03:48:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:09 trial086 ceph-mon[98535]: pgmap v760: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 2.90k op/s 2026-02-18T03:48:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/102038484' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3668167721' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1702342675' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:09 trial034 ceph-mon[109579]: pgmap v760: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 2.90k op/s 2026-02-18T03:48:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/102038484' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3668167721' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:09.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:09 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1702342675' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:11 trial034 ceph-mon[109579]: pgmap v761: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.71k op/s 2026-02-18T03:48:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:11 trial086 ceph-mon[98535]: pgmap v761: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.71k op/s 2026-02-18T03:48:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:11.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.60 3.5M 3.2M 0.0k 34.5M 31.9M 0.0k nvme12n3 2026-02-18T03:48:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 3.2M 3.2M 0.0k 32.2M 32.0M 0.0k nvme16n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 3.1M 3.2M 0.0k 31.5M 32.3M 0.0k nvme20n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 3.3M 3.2M 0.0k 33.0M 31.6M 0.0k nvme24n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 189.10 2.9M 3.2M 0.0k 29.0M 31.9M 0.0k nvme28n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 210.20 3.0M 3.1M 0.0k 30.2M 30.7M 0.0k nvme32n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 3.2M 3.2M 0.0k 32.1M 32.1M 0.0k nvme36n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 3.0M 3.1M 0.0k 29.9M 31.5M 0.0k nvme40n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 3.2M 3.3M 0.0k 31.9M 33.0M 0.0k nvme44n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 3.1M 3.1M 0.0k 30.5M 30.6M 0.0k nvme48n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 3.1M 3.3M 0.0k 30.6M 33.4M 0.0k nvme4n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 3.3M 3.0M 0.0k 32.7M 29.6M 0.0k nvme52n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.8M 2.8M 0.0k 28.0M 27.9M 0.0k nvme56n3 2026-02-18T03:48:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 188.80 3.0M 3.1M 0.0k 29.9M 31.5M 0.0k nvme60n3 2026-02-18T03:48:11.742 INFO:tasks.workunit.client.0.trial014.stdout: 208.70 2.5M 2.6M 0.0k 25.1M 25.5M 0.0k nvme64n3 2026-02-18T03:48:11.742 INFO:tasks.workunit.client.0.trial014.stdout: 195.10 3.1M 3.1M 0.0k 30.8M 30.5M 0.0k nvme8n3 2026-02-18T03:48:11.742 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:13 trial086 ceph-mon[98535]: pgmap v762: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.04k op/s 2026-02-18T03:48:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:13 trial034 ceph-mon[109579]: pgmap v762: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.04k op/s 2026-02-18T03:48:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:15 trial086 ceph-mon[98535]: pgmap v763: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.48k op/s 2026-02-18T03:48:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:15 trial034 ceph-mon[109579]: pgmap v763: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.48k op/s 2026-02-18T03:48:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4018946449' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1267270409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1941660542' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:16.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4018946449' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1267270409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:16.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:16 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1941660542' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:17 trial086 ceph-mon[98535]: pgmap v764: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.30k op/s 2026-02-18T03:48:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:17 trial034 ceph-mon[109579]: pgmap v764: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.30k op/s 2026-02-18T03:48:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:19 trial086 ceph-mon[98535]: pgmap v765: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.81k op/s 2026-02-18T03:48:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:19 trial034 ceph-mon[109579]: pgmap v765: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.81k op/s 2026-02-18T03:48:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:21 trial086 ceph-mon[98535]: pgmap v766: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 3.61k op/s 2026-02-18T03:48:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:21 trial034 ceph-mon[109579]: pgmap v766: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 3.61k op/s 2026-02-18T03:48:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:21.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:21.738 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 3.1M 3.1M 0.0k 30.6M 31.2M 0.0k nvme12n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 3.2M 3.0M 0.0k 32.2M 30.0M 0.0k nvme16n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 3.0M 3.0M 0.0k 29.9M 29.5M 0.0k nvme20n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 3.1M 3.2M 0.0k 30.9M 31.5M 0.0k nvme24n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.9M 3.0M 0.0k 28.9M 30.1M 0.0k nvme28n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.80 2.9M 2.9M 0.0k 29.4M 29.2M 0.0k nvme32n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.30 3.0M 3.1M 0.0k 29.7M 30.8M 0.0k nvme36n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.10 3.1M 3.1M 0.0k 31.3M 30.7M 0.0k nvme40n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 3.0M 3.0M 0.0k 30.0M 30.2M 0.0k nvme44n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.9M 2.9M 0.0k 28.7M 29.4M 0.0k nvme48n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 3.0M 3.0M 0.0k 29.8M 30.1M 0.0k nvme4n3 2026-02-18T03:48:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 3.2M 3.1M 0.0k 32.3M 31.3M 0.0k nvme52n3 2026-02-18T03:48:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 3.1M 3.3M 0.0k 30.6M 32.8M 0.0k nvme56n3 2026-02-18T03:48:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 3.1M 3.0M 0.0k 30.7M 29.8M 0.0k nvme60n3 2026-02-18T03:48:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 3.0M 3.2M 0.0k 30.2M 31.6M 0.0k nvme64n3 2026-02-18T03:48:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.80 2.9M 3.2M 0.0k 28.8M 31.7M 0.0k nvme8n3 2026-02-18T03:48:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:48:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:48:22.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:48:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:23 trial086 ceph-mon[98535]: pgmap v767: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.96k op/s 2026-02-18T03:48:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2518411418' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2396787182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2132725819' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:23 trial034 ceph-mon[109579]: pgmap v767: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.96k op/s 2026-02-18T03:48:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2518411418' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2396787182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:23 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2132725819' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:25 trial086 ceph-mon[98535]: pgmap v768: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.43k op/s 2026-02-18T03:48:25.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:25 trial034 ceph-mon[109579]: pgmap v768: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.43k op/s 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: pgmap v769: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.26k op/s 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: pgmap v769: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.26k op/s 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:27 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:27.730 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:48:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:29 trial086 ceph-mon[98535]: pgmap v770: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.79k op/s 2026-02-18T03:48:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:29 trial034 ceph-mon[109579]: pgmap v770: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.79k op/s 2026-02-18T03:48:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1578530127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1906812588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3864521869' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1578530127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1906812588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:30 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3864521869' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:31 trial086 ceph-mon[98535]: pgmap v771: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 54 MiB/s rd, 54 MiB/s wr, 3.59k op/s 2026-02-18T03:48:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:31 trial034 ceph-mon[109579]: pgmap v771: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 54 MiB/s rd, 54 MiB/s wr, 3.59k op/s 2026-02-18T03:48:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.8M 2.9M 0.0k 28.5M 29.0M 0.0k nvme12n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.60 3.2M 3.0M 0.0k 31.5M 29.8M 0.0k nvme16n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 3.1M 2.9M 0.0k 31.3M 29.2M 0.0k nvme20n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.9M 3.0M 0.0k 29.3M 29.7M 0.0k nvme24n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.40 2.7M 3.0M 0.0k 27.2M 30.4M 0.0k nvme28n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.30 2.9M 2.7M 0.0k 29.0M 27.5M 0.0k nvme32n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.00 2.9M 3.0M 0.0k 29.3M 30.3M 0.0k nvme36n3 2026-02-18T03:48:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 211.40 3.1M 2.9M 0.0k 31.0M 28.9M 0.0k nvme40n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 192.80 2.8M 3.0M 0.0k 27.9M 29.6M 0.0k nvme44n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 203.20 2.9M 2.8M 0.0k 29.3M 28.3M 0.0k nvme48n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.9M 2.9M 0.0k 29.0M 29.3M 0.0k nvme4n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.60 3.1M 3.1M 0.0k 30.8M 30.9M 0.0k nvme52n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.40 3.0M 2.9M 0.0k 30.0M 29.1M 0.0k nvme56n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.60 3.1M 3.0M 0.0k 30.5M 29.6M 0.0k nvme60n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 3.2M 3.0M 0.0k 31.9M 30.0M 0.0k nvme64n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 192.00 3.0M 3.0M 0.0k 29.8M 30.2M 0.0k nvme8n3 2026-02-18T03:48:31.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:33 trial086 ceph-mon[98535]: pgmap v772: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.95k op/s 2026-02-18T03:48:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:33 trial034 ceph-mon[109579]: pgmap v772: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.95k op/s 2026-02-18T03:48:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:35 trial086 ceph-mon[98535]: pgmap v773: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.42k op/s 2026-02-18T03:48:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:35 trial034 ceph-mon[109579]: pgmap v773: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.42k op/s 2026-02-18T03:48:35.877 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #7: thrashed- nvmeof.a (by ceph_daemon_stop); 2026-02-18T03:48:35.877 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:48:35.877 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Active: inactive (dead) since Wed 2026-02-18 03:47:15 UTC; 1min 20s ago 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Duration: 11min 18.376s 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94533 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Process: 94534 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Process: 112912 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.907 INFO:teuthology.orchestra.run.trial034.stdout: Process: 113138 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout: Process: 113176 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 94656 (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 45min 29.723s 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[94656]: [18-Feb-2026 03:47:15] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 podman[112985]: 2026-02-18 03:47:15.072715043 +0000 UTC m=+3.911751387 container died 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, io.spdk.build.ceph-release=20.2.0, io.buildah.version=1.29.0, io.spdk.build.makeflags=, maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, release=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.6.5, distribution-scope=public, io.ceph.summary=Ceph NVMe over Fabrics Gateway, architecture=x86_64, vendor=Red Hat, Inc., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.maintainer=Ceph Developers , io.ceph.git.branch=devel, vcs-type=git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.pkgdep-args=--rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 podman[112985]: 2026-02-18 03:47:15.084528954 +0000 UTC m=+3.923565298 container remove 63cbb06c444fab0d8fe13782272f50504b2cdd5758d2d8a8496f4b92ff09dd49 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.ceph-release=20.2.0, build-date=2026-02-11 09:53:49 UTC, io.ceph.version=1.6.5, url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.version=9.0-30.el9, io.ceph.git.branch=devel, io.ceph.maintainer=Ceph Developers , io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, com.redhat.component=ubi9-container, distribution-scope=public, io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, io.openshift.wants=ceph,rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, release=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=25.09, summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.ceph.nvmeof=, maintainer=Ceph Developers , io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined) 2026-02-18T03:48:35.908 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 bash[112985]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:48:35.909 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:48:35.909 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:48:35.909 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:47:15 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 45min 29.723s CPU time, 381.8M memory peak. 2026-02-18T03:48:35.909 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:48:35.910 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 8min ago 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:48:35.941 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 354.6M (peak: 358.9M) 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 34min 38.873s 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:48:35.942 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.202390] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000277 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.218420] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000292 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.234421] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000297 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.250398] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000291 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.266411] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000321 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.282379] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000265 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.298292] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000189 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.314323] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000222 seconds 2026-02-18T03:48:35.944 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.338445] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000290 seconds 2026-02-18T03:48:35.945 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:47:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:47:34.354316] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000199 seconds 2026-02-18T03:48:35.945 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:48:35.977 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:35.977 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:48:35.977 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:44:19 UTC; 4min 16s ago 2026-02-18T03:48:35.977 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91482 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91483 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 91554 (conmon) 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 339.2M (peak: 349.2M) 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 16min 54.962s 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91556 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91558 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91650 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:48:35.978 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─92256 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:48:35.979 INFO:teuthology.orchestra.run.trial155.stdout: │ └─92321 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:35.979 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:48:35.979 INFO:teuthology.orchestra.run.trial155.stdout: └─91554 /usr/bin/conmon --api-version 1 -c 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -u 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata -p /run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:48:35.979 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:48:35.980 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.762675] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000322 seconds 2026-02-18T03:48:35.980 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.778705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000343 seconds 2026-02-18T03:48:35.980 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.794719] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000331 seconds 2026-02-18T03:48:35.980 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.810664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000283 seconds 2026-02-18T03:48:35.980 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.826721] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000335 seconds 2026-02-18T03:48:35.981 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.842646] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000267 seconds 2026-02-18T03:48:35.981 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.858687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000281 seconds 2026-02-18T03:48:35.981 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:48:35.981 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:48:35.981 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:48:35.981 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:48:36.009 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:36.009 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:48:36.009 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 5min ago 2026-02-18T03:48:36.009 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 368.7M (peak: 371.3M) 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 24min 12.455s 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:36.010 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:48:36.011 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:48:36.012 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:48:36.012 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:48:36.012 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:48:36.012 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:48:36.013 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:48:36.241 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:48:36.241 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 69s ago 23m trial034=x;count:1 2026-02-18T03:48:36.242 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 8m ago 23m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:48:36.242 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 3/4 8m ago 22m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:48:36.242 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 8m ago 22m trial155 2026-02-18T03:48:36.251 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:48:36.435 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:48:36.435 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 stopped 69s ago 12m - - 2026-02-18T03:48:36.435 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (8m) 8m ago 12m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:48:36.435 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (4m) 2m ago 4m 330M - 1.6.5 99a57256b38c 6656e6ed9326 2026-02-18T03:48:36.435 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (5m) 5m ago 12m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:48:36.443 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:48:36.673 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum a,b; 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:36.673 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum a,b 2026-02-18T03:48:36.673 INFO:teuthology.orchestra.run.trial177.stdout: mon.c (rank 1) addr [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] is down (out of quorum) 2026-02-18T03:48:36.673 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:36.673 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:48:36.682 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum a,b 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,b (age 70s) [leader: a], out of quorum: c 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 24m) 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 22m), 8 in (since 22m) 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 3 gateways active (3 hosts) 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:48:36.901 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: usage: 55 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: client: 48 MiB/s rd, 48 MiB/s wr, 1.64k op/s rd, 1.62k op/s wr 2026-02-18T03:48:36.902 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:48:36.910 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:48:37.143 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 218, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 1, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 154, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:48:37.144 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:48:37.145 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:48:37.153 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.210 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.211 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:48:37.212 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:48:37.258 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.259 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:48:37.303 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.303 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:48:37.349 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.349 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: pgmap v774: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.27k op/s 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1971195279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4084880599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2848579946' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3614483674' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:48:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4147505284' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:48:37.394 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.394 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:48:37.439 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.439 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:48:37.483 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.484 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: pgmap v774: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.27k op/s 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/1971195279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4084880599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2848579946' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3614483674' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:48:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:37 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4147505284' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:48:37.527 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.527 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:48:37.571 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.571 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:48:37.614 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.614 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:48:37.658 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.659 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:48:37.702 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.703 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:48:37.747 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.747 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:48:37.791 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.791 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:48:37.835 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.835 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:48:37.879 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.879 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:48:37.924 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.924 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:48:37.969 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:37.970 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:48:38.013 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.014 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:48:38.056 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.057 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:48:38.101 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.101 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:48:38.145 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.146 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:48:38.189 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.190 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:48:38.235 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.235 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:48:38.278 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.278 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:48:38.322 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.323 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:48:38.365 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.366 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:48:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:38 trial086 ceph-mon[98535]: from='client.121881 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:38 trial086 ceph-mon[98535]: from='client.121902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4118197125' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:48:38.450 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.451 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:48:38.495 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.495 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:48:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:38 trial034 ceph-mon[109579]: from='client.121881 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:38 trial034 ceph-mon[109579]: from='client.121902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:38 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4118197125' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:48:38.539 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.541 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:48:38.624 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.625 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:48:38.670 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.671 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:48:38.717 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.718 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:48:38.762 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.763 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:48:38.806 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.807 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:48:38.892 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.893 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:48:38.938 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.939 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:48:38.984 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:38.985 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:48:39.028 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.029 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:48:39.113 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.115 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:48:39.160 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.161 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:48:39.206 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.207 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:48:39.252 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.253 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:48:39.298 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.299 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:48:39.345 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.346 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:48:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:39 trial086 ceph-mon[98535]: pgmap v775: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.81k op/s 2026-02-18T03:48:39.389 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.390 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:48:39.434 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.435 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:48:39.519 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.520 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:48:39.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:39 trial034 ceph-mon[109579]: pgmap v775: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.81k op/s 2026-02-18T03:48:39.564 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.565 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:48:39.607 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.608 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:48:39.692 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.692 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:48:39.736 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.736 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:48:39.780 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.780 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:48:39.826 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.826 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:48:39.871 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.871 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:48:39.915 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.916 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:48:39.959 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:39.960 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:48:40.003 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.003 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:48:40.048 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.049 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:48:40.092 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.092 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:48:40.136 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.136 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:48:40.180 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.180 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:48:40.224 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.224 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:48:40.268 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.268 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:48:40.311 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:48:40.311 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:48:40.311 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:48:40.311 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.a 2026-02-18T03:48:40.311 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon restart nvmeof.nvmeof.a --force 2026-02-18T03:48:40.311 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:48:40.311 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.c 2026-02-18T03:48:40.312 INFO:tasks.cephadm.mon.c:Restarting mon.c (starting--it wasn't running)... 2026-02-18T03:48:40.312 DEBUG:teuthology.orchestra.run.trial155:mon.c> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service 2026-02-18T03:48:40.313 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:48:40.511 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to restart nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:48:40.522 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 78 secs before thrashing 2026-02-18T03:48:40.536 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:48:40.536 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:48:40.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 systemd[1]: Starting Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 podman[104150]: 2026-02-18 03:48:40.499967856 +0000 UTC m=+0.017938917 container create 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 podman[104150]: 2026-02-18 03:48:40.525661199 +0000 UTC m=+0.043632270 container init 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 podman[104150]: 2026-02-18 03:48:40.528486452 +0000 UTC m=+0.046457513 container start 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug) 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 bash[104150]: 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 podman[104150]: 2026-02-18 03:48:40.492326301 +0000 UTC m=+0.010297372 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 systemd[1]: Started Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:48:40.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: pidfile_write: ignore empty --pid-file 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: load: jerasure load: lrc 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Git sha 0 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: DB SUMMARY 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: DB Session ID: I9VFPS508YAW6KFVBLGM 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: MANIFEST file: MANIFEST-000061 size: 547 Bytes 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000066.sst 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000064.log size: 460815 ; 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:48:40.731 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.env: 0x5612b6b05100 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.info_log: 0x5612bc77ce80 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.statistics: (nil) 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.use_fsync: 0 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:48:40.732 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.db_log_dir: 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.wal_dir: 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:48:40.733 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.write_buffer_manager: 0x5612bc780b40 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:48:40.734 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.unordered_write: 0 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.row_cache: None 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.wal_filter: None 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:48:40.735 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.wal_compression: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:48:40.736 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:48:40.737 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_open_files: -1 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Compression algorithms supported: 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kZSTD supported: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:48:40.738 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000061 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.merge_operator: 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_filter: None 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:48:40.739 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5612bc77c3c0) 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: index_type: 0 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_index_type: 0 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: index_shortening: 1 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: checksum: 4 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: no_block_cache: 0 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache: 0x5612bc79db90 2026-02-18T03:48:40.740 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_options: 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: capacity : 536870912 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: num_shard_bits : 4 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: strict_capacity_limit : 0 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: block_cache_compressed: (nil) 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: persistent_cache: (nil) 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size: 4096 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: block_size_deviation: 10 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: block_restart_interval: 16 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: index_block_restart_interval: 1 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: metadata_block_size: 4096 2026-02-18T03:48:40.741 INFO:journalctl@ceph.mon.c.trial155.stdout: partition_filters: 0 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: use_delta_encoding: 1 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: filter_policy: bloomfilter 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: whole_key_filtering: 1 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: verify_compression: 0 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: format_version: 5 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_index_compression: 1 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: block_align: 0 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: max_auto_readahead_size: 262144 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: prepopulate_block_cache: 0 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:48:40.742 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression: NoCompression 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.num_levels: 7 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:48:40.743 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:48:40.744 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:48:40.744 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:48:40.744 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:48:40.744 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:48:40.744 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:48:40.745 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:48:40.745 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:48:40.746 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:48:40.747 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:48:40.748 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:48:40.749 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.ttl: 2592000 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:48:40.750 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000061 succeeded,manifest_file_number is 61, next_file_number is 68, last_sequence is 24778, log_number is 64,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 64 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 64 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 711ce751-a115-4d3b-ae33-6c3f58e6c51c 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386520562301, "job": 1, "event": "recovery_started", "wal_files": [64]} 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #64 mode 2 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386520564207, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 69, "file_size": 302896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 24783, "largest_seqno": 25137, "table_properties": {"data_size": 300529, "index_size": 944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 389, "raw_key_size": 3589, "raw_average_key_size": 23, "raw_value_size": 297205, "raw_average_value_size": 1968, "num_data_blocks": 42, "num_entries": 151, "num_filter_entries": 151, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771386520, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "711ce751-a115-4d3b-ae33-6c3f58e6c51c", "db_session_id": "I9VFPS508YAW6KFVBLGM", "orig_file_number": 69, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386520564282, "job": 1, "event": "recovery_finished"} 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:5047] Creating manifest 71 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:48:40.751 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000064.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5612bc7a0700 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: DB pointer 0x5612bc7b2000 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: ** DB Stats ** 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:48:40.752 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: L0 1/0 295.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: L6 1/0 8.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: Sum 2/0 8.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: ** Compaction Stats [default] ** 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:48:40.753 INFO:journalctl@ceph.mon.c.trial155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 236.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Cumulative compaction: 0.00 GB write, 69.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Interval compaction: 0.00 GB write, 69.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:48:40.754 INFO:journalctl@ceph.mon.c.trial155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache BinnedLRUCache@0x5612bc79db90#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.45 KB,8.49366e-05%) IndexBlock(1,1.08 KB,0.000205636%) Misc(1,0.00 KB,0%) 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: starting mon.c rank 1 at public addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] at bind addrs [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).mds e1 new map 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).mds e1 print_map 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: e1 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:48:40.755 INFO:journalctl@ceph.mon.c.trial155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout: legacy client fscid: -1 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout: 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout: No filesystems configured 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).osd e59 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).osd e59 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).osd e59 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).osd e59 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:48:40.756 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:40 trial155 ceph-mon[104170]: mon.c@-1(???).paxosservice(auth 1..50) refresh upgraded, format 0 -> 3 2026-02-18T03:48:40.774 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":54,"quorum":[0,2],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":74,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: pgmap v776: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 52 MiB/s wr, 3.62k op/s 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:41.225 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.226 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:41.226 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2279275174' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:41.226 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.226 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.226 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:41.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:40 trial034 systemd[1]: Starting Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 podman[114109]: 2026-02-18 03:48:41.001793639 +0000 UTC m=+0.019723529 container create 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.buildah.version=1.29.0, io.spdk.build.target-arch=x86-64-v2, vcs-type=git, build-date=2026-02-11 09:53:49 UTC, io.ceph.maintainer=Ceph Developers , io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, release=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, version=1.6.5, io.ceph.nvmeof=, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.makeflags=, vendor=Red Hat, Inc., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.version=25.09, architecture=x86_64, io.openshift.wants=ceph,rbd, name=ceph-nvmeof, io.ceph.version=1.6.5, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, maintainer=Ceph Developers ) 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 podman[114109]: 2026-02-18 03:48:41.036061468 +0000 UTC m=+0.053991348 container init 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.nvmeof=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.makeflags=, io.spdk.build.pkgdep-args=--rbd, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.spdk.git.branch=undefined, vcs-type=git, vendor=Red Hat, Inc., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, org.centos.version=9.0-30.el9, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, build-date=2026-02-11 09:53:49 UTC, distribution-scope=public, release=, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.component=ceph-nvmeof, io.ceph.maintainer=Ceph Developers , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.target-arch=x86-64-v2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, com.redhat.component=ubi9-container, io.spdk.version=25.09, maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, io.ceph.version=1.6.5, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, version=1.6.5) 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 podman[114109]: 2026-02-18 03:48:41.03857151 +0000 UTC m=+0.056501390 container start 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.spdk.version=25.09, version=1.6.5, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, name=ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.version=9.0-30.el9, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.nvmeof=, url=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, distribution-scope=public, io.spdk.git.branch=undefined, io.ceph.component=ceph-nvmeof, vcs-type=git, architecture=x86_64, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, release=, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, vendor=Red Hat, Inc., org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, maintainer=Ceph Developers ) 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 bash[114109]: 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 podman[114109]: 2026-02-18 03:48:40.99363619 +0000 UTC m=+0.011566070 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 systemd[1]: Started Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:48:41.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: pgmap v776: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 52 MiB/s wr, 3.62k op/s 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2279275174' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:41.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:41 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a, using rotation 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:48:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [gateway] 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): name = client.nvmeof.nvmeof.a 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:48:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): port = 5500 2026-02-18T03:48:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:48:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:48:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:48:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:48:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:48:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): force_tls = False 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [discovery] 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:48:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): port = 8009 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [ceph] 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): pool = mypool 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): id = nvmeof.nvmeof.a 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [mtls] 2026-02-18T03:48:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [spdk] 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:48:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): transports = tcp 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): [monitor] 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.a 2026-02-18T03:48:41.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.34:5499 for group id 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.a group id=0 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:48:41.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:48:41.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:48:41.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:48:41.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:41] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:48:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 3.0M 2.9M 0.0k 29.7M 29.0M 0.0k nvme12n3 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.30 3.2M 2.8M 0.0k 31.7M 28.0M 0.0k nvme16n3 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.40 2.9M 2.8M 0.0k 28.6M 27.9M 0.0k nvme20n3 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.8M 2.8M 0.0k 27.9M 28.2M 0.0k nvme24n3 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 2.9M 2.8M 0.0k 29.3M 27.7M 0.0k nvme28n3 2026-02-18T03:48:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.80 2.5M 2.7M 0.0k 25.2M 27.4M 0.0k nvme32n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.8M 2.8M 0.0k 28.5M 28.4M 0.0k nvme36n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 199.10 2.9M 2.9M 0.0k 28.8M 28.8M 0.0k nvme40n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.9M 2.9M 0.0k 28.6M 28.7M 0.0k nvme44n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.80 2.7M 2.8M 0.0k 26.9M 27.7M 0.0k nvme48n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.10 2.8M 2.9M 0.0k 28.1M 28.6M 0.0k nvme4n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 195.00 2.7M 3.0M 0.0k 26.9M 29.6M 0.0k nvme52n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 3.1M 2.8M 0.0k 30.9M 28.2M 0.0k nvme56n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 3.1M 2.8M 0.0k 30.6M 27.9M 0.0k nvme60n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 3.0M 3.0M 0.0k 30.1M 29.6M 0.0k nvme64n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.20 2.9M 2.9M 0.0k 28.8M 28.6M 0.0k nvme8n3 2026-02-18T03:48:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v751: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 3.65k op/s 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v752: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 3.02k op/s 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v753: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 3.49k op/s 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3534000380' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3591518493' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4075057830' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v754: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.32k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v755: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 29 MiB/s wr, 2.85k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v756: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.69k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2214237185' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2753200777' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2296096577' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v757: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 33 MiB/s wr, 3.04k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v758: 33 pgs: 33 active+clean; 16 GiB data, 54 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 41 MiB/s wr, 3.52k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v759: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.35k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v760: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 2.90k op/s 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/102038484' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3668167721' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1702342675' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v761: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.71k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v762: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 44 MiB/s wr, 3.04k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v763: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.48k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4018946449' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1267270409' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1941660542' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v764: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 51 MiB/s wr, 3.30k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v765: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.81k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v766: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 55 MiB/s rd, 56 MiB/s wr, 3.61k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v767: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 46 MiB/s wr, 2.96k op/s 2026-02-18T03:48:42.481 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2518411418' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2396787182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2132725819' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v768: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 52 MiB/s rd, 52 MiB/s wr, 3.43k op/s 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v769: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 49 MiB/s rd, 50 MiB/s wr, 3.26k op/s 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v770: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 2.79k op/s 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1578530127' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1906812588' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.482 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3864521869' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v771: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 54 MiB/s rd, 54 MiB/s wr, 3.59k op/s 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v772: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 2.95k op/s 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v773: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 51 MiB/s rd, 51 MiB/s wr, 3.42k op/s 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v774: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 3.27k op/s 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1971195279' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4084880599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2848579946' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3614483674' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4147505284' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.121881 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:42.483 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.121902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4118197125' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v775: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 2.81k op/s 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: pgmap v776: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 53 MiB/s rd, 52 MiB/s wr, 3.62k op/s 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2279275174' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.484 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:48:42.485 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:41 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:48:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: pgmap v777: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 2.99k op/s 2026-02-18T03:48:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:48:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:48:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:48:42.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 24m) 2026-02-18T03:48:42.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:48:42.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:42.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:42.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:42 trial086 ceph-mon[98535]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:48:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: pgmap v777: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 2.99k op/s 2026-02-18T03:48:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: mon.c calling monitor election 2026-02-18T03:48:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: mon.a calling monitor election 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: monmap epoch 3 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: min_mon_release 20 (tentacle) 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: election_strategy: 1 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: fsmap 2026-02-18T03:48:42.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:48:42.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: mgrmap e15: x(active, since 24m) 2026-02-18T03:48:42.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:48:42.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:42.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:42.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:42 trial155 ceph-mon[104170]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: pgmap v777: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 2.99k op/s 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: mon.c calling monitor election 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: mon.a calling monitor election 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: monmap epoch 3 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: min_mon_release 20 (tentacle) 2026-02-18T03:48:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: election_strategy: 1 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: fsmap 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: mgrmap e15: x(active, since 24m) 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: Health detail: HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: [WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:48:43.022 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:42 trial034 ceph-mon[109579]: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: INFO: Setting log level to WARNING 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.311986] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:48:43.587 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.312053] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.428129] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.459571] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.459583] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.459594] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.459595] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:48:43.588 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.585762] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:48:43.786 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:48:43.843 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:48:43.844 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO discovery.py:369 (78): discovery addr: 10.20.193.34 port: 8009 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.633175] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.633232] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial034). 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial034). 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.845 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO state.py:2073 (78): Initialization is over (discovery-trial034). 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.846 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:48:43.847 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:48:43.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.065 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:48:44.078 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:48:44.078 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:48:44.079 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:48:44.101 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3503445996' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.101 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2093929686' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.101 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/891210130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.101 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2044237039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:48:44.101 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/86326570' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:48:44.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.978024] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.34:0/3279799801, rc 0 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.978340] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.34:0/3279799801 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.34:0/3279799801' 2026-02-18T03:48:44.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:43.998239] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:44.104 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:43] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:48:44.104 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.002843] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:48:44.104 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.003625] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:48:44.104 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.003656] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 361573, 2026-02-18T03:48:44.161 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.162 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:48:44.163 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.164 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:48:44.165 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.166 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:48:44.167 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.168 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:48:44.169 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.170 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.171 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.172 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.173 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "num": 44 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:48:44.174 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:48:44.176 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:48:44.176 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:48:44.176 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 532358, 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:48:44.299 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.300 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:48:44.301 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.302 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:48:44.303 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:44.304 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.305 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.306 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.307 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.308 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.309 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:48:44.310 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:48:44.311 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.312 INFO:teuthology.orchestra.run.trial034.stdout: "num": 73 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:48:44.313 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:48:44.315 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:48:44.315 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:48:44.315 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.148822] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.34:0/231204719, rc 0 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.149085] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.34:0/231204719 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.34:0/231204719' 2026-02-18T03:48:44.359 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.167047] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.177285] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.177328] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.334523] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.34:0/3671201467, rc 0 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.334608] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.34:0/3671201467 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.34:0/3671201467' 2026-02-18T03:48:44.360 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.358089] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3503445996' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2093929686' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/891210130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2044237039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:48:44.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/86326570' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:48:44] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:48:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:48:44.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:48:44.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:44.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:44 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:35306 2026-02-18T03:48:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3503445996' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2093929686' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/891210130' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2044237039' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:48:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/86326570' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.366589] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.366627] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.523626] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.34:0/2213184722, rc 0 2026-02-18T03:48:44.655 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.523712] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.34:0/2213184722 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.34:0/2213184722' 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.541544] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.547581] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.547612] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:44.656 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.690007] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.34:0/1298434946, rc 0 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.691067] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.34:0/1298434946 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.34:0/1298434946' 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.715040] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.723448] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.723490] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.867846] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.34:0/1329808583, rc 0 2026-02-18T03:48:45.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.867925] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.34:0/1329808583 2026-02-18T03:48:45.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.34:0/1329808583' 2026-02-18T03:48:45.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.888779] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:44] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:48:45.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.895712] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:48:45.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:44 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:44.895752] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: pgmap v778: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 49 MiB/s wr, 3.44k op/s 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: Cluster is now healthy 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/4219357428' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.053993] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.34:0/2925117763, rc 0 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.055081] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.34:0/2925117763 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.34:0/2925117763' 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.085550] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.094991] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.095028] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:45.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.232302] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.34:0/1852001615, rc 0 2026-02-18T03:48:45.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.237163] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.34:0/1852001615 2026-02-18T03:48:45.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.34:0/1852001615' 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: pgmap v778: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 49 MiB/s wr, 3.44k op/s 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4219357428' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:45 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: pgmap v778: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 49 MiB/s wr, 3.44k op/s 2026-02-18T03:48:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:48:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: Cluster is now healthy 2026-02-18T03:48:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/4219357428' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:48:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:45.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:45 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.275199] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.280616] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.280656] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.598 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.463857] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.34:0/3305262002, rc 0 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.464068] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.34:0/3305262002 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.34:0/3305262002' 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.487096] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.501322] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.501369] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.599 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 5234, 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:48:45.802 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 3, 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:45.803 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:48:45.804 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:45.805 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:48:45.806 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:48:45.807 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:48:45.808 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.809 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:45.810 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.811 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.812 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:48:45.813 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.814 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:48:45.815 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:48:45.817 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:48:45.817 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:48:45.817 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:48:45.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.648177] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.34:0/323247593, rc 0 2026-02-18T03:48:45.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.649072] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.34:0/323247593 2026-02-18T03:48:45.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.34:0/323247593' 2026-02-18T03:48:45.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.670014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.848 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.683286] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.683321] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.819942] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.34:0/213297300, rc 0 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.820083] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.34:0/213297300 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.34:0/213297300' 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.841766] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.847222] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:48:45.849 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:45.847249] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:46.092 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:45 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:45] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.003145] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.34:0/2755964363, rc 0 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.004074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.34:0/2755964363 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.34:0/2755964363' 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.022924] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.035781] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:48:46.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.035821] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:46.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:46.154 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.192612] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.34:0/135598089, rc 0 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.195075] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.34:0/135598089 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.34:0/135598089' 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.219233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.226543] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.226583] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:46.419 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:46.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:46.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.400621] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.34:0/567904847, rc 0 2026-02-18T03:48:46.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.400724] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.34:0/567904847 2026-02-18T03:48:46.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.34:0/567904847' 2026-02-18T03:48:46.420 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.417812] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:46.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.426088] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.426131] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.586719] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.34:0/3807446139, rc 0 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.589058] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.34:0/3807446139 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.34:0/3807446139' 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.605770] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:46.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:48:46.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.615136] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:48:46.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.615177] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:46.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:46.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:46.732 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:46.732 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: pgmap v779: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/704073465' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {auth=59,config=2,health=13,kv=26} crc {auth=659564789,config=509344512,health=836525305,kv=3756472643}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=447608586}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {kv=62,logm=38} crc {kv=5300515,logm=2427987991}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4254205454}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643074630}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3062033009}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1163123459}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1504739100}) 2026-02-18T03:48:46.733 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017704811}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3189084228}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3847073}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1328600566}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981810379}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2784726068}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739887479}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3377219187}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=340249316}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1764736891}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4167496606}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3224322596}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3284001888}) 2026-02-18T03:48:46.734 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2215152898}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4093334029}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2587129189}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2088127299}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=698910376}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3823793679}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1536402505}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=331034472}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2083657338}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2115283706}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3478727022}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1805361867}) 2026-02-18T03:48:46.735 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=376086117}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=799011304}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2733028596}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734058641}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=480874536}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539437254}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4165011050}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1117334837}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=85186367}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3107364847}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1331852647}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4019590924}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=659208439}) 2026-02-18T03:48:46.736 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3244379099}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1848674343}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1463872282}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973202452}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1565189606}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973894024}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=45} crc {logm=2385876152,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1152668083}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3653590475}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=23,mon_config_key=77} crc {mgrstat=901857283,mon_config_key=3154221935}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1963564141}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=45,monmap=5,nvmeofgw=50} crc {mon_config_key=3427266922,monmap=1407976167,nvmeofgw=1318487558}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1440525825}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=72,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=17} crc {nvmeofgw=528015801,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688,osdmap=642196258}) 2026-02-18T03:48:46.737 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=2776703687}) 2026-02-18T03:48:46.738 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-mon[109579]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=6} crc {osdmap=178555650}) 2026-02-18T03:48:46.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:46.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: pgmap v779: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/704073465' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {auth=59,config=2,health=13,kv=26} crc {auth=659564789,config=509344512,health=836525305,kv=3756472643}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=447608586}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=62,logm=38} crc {kv=5300515,logm=2427987991}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4254205454}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643074630}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3062033009}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1163123459}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1504739100}) 2026-02-18T03:48:46.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017704811}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3189084228}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3847073}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1328600566}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981810379}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2784726068}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739887479}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3377219187}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=340249316}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1764736891}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4167496606}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3224322596}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3284001888}) 2026-02-18T03:48:46.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2215152898}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4093334029}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2587129189}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2088127299}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=698910376}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3823793679}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1536402505}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=331034472}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2083657338}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2115283706}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3478727022}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1805361867}) 2026-02-18T03:48:46.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=376086117}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=799011304}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2733028596}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734058641}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=480874536}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539437254}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4165011050}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1117334837}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=85186367}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3107364847}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1331852647}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4019590924}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=659208439}) 2026-02-18T03:48:46.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3244379099}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1848674343}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1463872282}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973202452}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1565189606}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973894024}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=45} crc {logm=2385876152,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1152668083}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3653590475}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=23,mon_config_key=77} crc {mgrstat=901857283,mon_config_key=3154221935}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1963564141}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=45,monmap=5,nvmeofgw=50} crc {mon_config_key=3427266922,monmap=1407976167,nvmeofgw=1318487558}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1440525825}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=72,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=17} crc {nvmeofgw=528015801,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688,osdmap=642196258}) 2026-02-18T03:48:46.878 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=2776703687}) 2026-02-18T03:48:46.879 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:46 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=6} crc {osdmap=178555650}) 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: pgmap v779: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 47 MiB/s rd, 46 MiB/s wr, 3.31k op/s 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/704073465' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {auth=59,config=2,health=13,kv=26} crc {auth=659564789,config=509344512,health=836525305,kv=3756472643}) 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=447608586}) 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {kv=62,logm=38} crc {kv=5300515,logm=2427987991}) 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4254205454}) 2026-02-18T03:48:46.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2643074630}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3062033009}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1163123459}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1504739100}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017704811}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3189084228}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3847073}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1328600566}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981810379}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2784726068}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739887479}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3377219187}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=340249316}) 2026-02-18T03:48:46.980 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1764736891}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4167496606}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3224322596}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3284001888}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2215152898}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4093334029}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2587129189}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2088127299}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=698910376}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3823793679}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1536402505}) 2026-02-18T03:48:46.981 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=331034472}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2083657338}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2115283706}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3478727022}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1805361867}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=376086117}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=799011304}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2733028596}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3734058641}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=480874536}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539437254}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4165011050}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1117334837}) 2026-02-18T03:48:46.982 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=85186367}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3107364847}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1331852647}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4019590924}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=659208439}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3244379099}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1848674343}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1463872282}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973202452}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1565189606}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3973894024}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=45} crc {logm=2385876152,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1152668083}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=3653590475}) 2026-02-18T03:48:46.983 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=23,mon_config_key=77} crc {mgrstat=901857283,mon_config_key=3154221935}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1963564141}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=45,monmap=5,nvmeofgw=50} crc {mon_config_key=3427266922,monmap=1407976167,nvmeofgw=1318487558}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=1440525825}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=72,osd_metadata=8,osd_pg_creating=1,osd_snap=2,osdmap=17} crc {nvmeofgw=528015801,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688,osdmap=642196258}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=2776703687}) 2026-02-18T03:48:46.984 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:46 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=6} crc {osdmap=178555650}) 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.788004] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.34:0/579206557, rc 0 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.797094] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.34:0/579206557 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.34:0/579206557' 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.818086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.835263] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:48:47.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:46.835300] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:47.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:47.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:46 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:46] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:47.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.000203] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.34:0/530477472, rc 0 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.001079] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.34:0/530477472 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.34:0/530477472' 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.025192] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.037304] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.037344] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:47.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.202780] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.34:0/688799396, rc 0 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.203086] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.34:0/688799396 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.34:0/688799396' 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.237856] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.242714] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:48:47.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.242756] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.422844] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.34:0/3980407588, rc 0 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.423092] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.34:0/3980407588 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.34:0/3980407588' 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.453110] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:48:47.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.479391] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:48:47.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.479457] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:47.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:47.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:47.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.675981] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.34:0/2514580548, rc 0 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.677089] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.34:0/2514580548 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.34:0/2514580548' 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.695108] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.699696] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.699730] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:48.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.843991] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.34:0/2339996932, rc 0 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.845082] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.34:0/2339996932 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.34:0/2339996932' 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.879100] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:47] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.892837] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:48:48.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:47 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:47.892883] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.077411] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.34:0/1142341572, rc 0 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.077487] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.34:0/1142341572 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.34:0/1142341572' 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.093506] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:48:48.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.101120] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.101146] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.251393] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.34:0/2874588007, rc 0 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.252086] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.34:0/2874588007 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.34:0/2874588007' 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.268956] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.277307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.277335] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.433810] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.34:0/1295552212, rc 0 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.433921] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.34:0/1295552212 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.34:0/1295552212' 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.456404] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.470357] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.470397] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.609956] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.34:0/3751995900, rc 0 2026-02-18T03:48:48.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.610081] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.34:0/3751995900 2026-02-18T03:48:48.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.34:0/3751995900' 2026-02-18T03:48:48.636 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.633783] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.957 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-mon[109579]: pgmap v780: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 2.84k op/s 2026-02-18T03:48:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:48:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.639453] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.639495] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.807778] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.34:0/425667644, rc 0 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.807855] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.34:0/425667644 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.34:0/425667644' 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.827769] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.838311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:48:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:48.838343] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:48 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:48] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:48.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:48 trial155 ceph-mon[104170]: pgmap v780: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 2.84k op/s 2026-02-18T03:48:49.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:48 trial086 ceph-mon[98535]: pgmap v780: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 39 MiB/s wr, 2.84k op/s 2026-02-18T03:48:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.018772] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.34:0/3303939807, rc 0 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.018865] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.34:0/3303939807 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.34:0/3303939807' 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.058265] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.063789] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.063824] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.219713] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.34:0/3795007098, rc 0 2026-02-18T03:48:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.219821] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.34:0/3795007098 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.34:0/3795007098' 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.262129] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.266751] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.266775] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:49.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.418944] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.34:0/1354052591, rc 0 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.419041] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.34:0/1354052591 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.34:0/1354052591' 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.433073] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.441232] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:48:49.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.441261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:49.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:49.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:49.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.606099] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.34:0/1996759618, rc 0 2026-02-18T03:48:49.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.607072] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.34:0/1996759618 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.34:0/1996759618' 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.623333] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.628511] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.628533] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.769606] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.34:0/129872609, rc 0 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.770074] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.34:0/129872609 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.34:0/129872609' 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.786259] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:49.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:48:49.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.796677] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:48:49.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.796714] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:49.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:49.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:50.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.969860] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.34:0/1029055076, rc 0 2026-02-18T03:48:50.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:49.969941] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.34:0/1029055076 2026-02-18T03:48:50.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:49 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:49] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.34:0/1029055076' 2026-02-18T03:48:50.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.008115] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:50.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:48:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.017371] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:48:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.017404] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:50.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.221130] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.230269] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.230305] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:50.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.378532] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:50.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:48:50.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.392546] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:48:50.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.392591] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:50.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:50.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.561616] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.572648] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.572679] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.753199] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:50.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:48:50.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.757689] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:48:50.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.757720] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:51.157 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-mon[109579]: pgmap v781: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.79k op/s 2026-02-18T03:48:51.157 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/828784101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.157 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3741087057' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.157 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/4169380196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.157 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.911070] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:50] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.915504] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:50 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:50.915536] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.047814] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.054883] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:48:51.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.054924] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:51.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.159 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:51 trial086 ceph-mon[98535]: pgmap v781: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.79k op/s 2026-02-18T03:48:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/828784101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3741087057' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4169380196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:51 trial155 ceph-mon[104170]: pgmap v781: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 50 MiB/s rd, 50 MiB/s wr, 3.79k op/s 2026-02-18T03:48:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:51 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/828784101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:51 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3741087057' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:51 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4169380196' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:51.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.211993] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:51.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:48:51.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.218952] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:48:51.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.218999] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.389656] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.396362] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.396404] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 2.7M 2.7M 0.0k 27.1M 27.3M 0.0k nvme12n3 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.90 2.6M 2.7M 0.0k 25.9M 26.7M 0.0k nvme16n3 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 188.20 2.4M 2.8M 0.0k 24.3M 27.5M 0.0k nvme20n3 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 192.60 2.8M 2.7M 0.0k 27.9M 27.2M 0.0k nvme24n3 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 196.60 2.7M 2.6M 0.0k 27.2M 26.2M 0.0k nvme28n3 2026-02-18T03:48:51.738 INFO:tasks.workunit.client.0.trial014.stdout: 193.80 2.4M 2.6M 0.0k 24.2M 26.3M 0.0k nvme32n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.30 2.6M 2.6M 0.0k 26.3M 26.5M 0.0k nvme36n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.30 2.4M 2.7M 0.0k 24.4M 26.8M 0.0k nvme40n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 187.60 2.5M 2.7M 0.0k 24.9M 27.4M 0.0k nvme44n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.30 2.8M 2.6M 0.0k 27.9M 25.7M 0.0k nvme48n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 2.7M 2.7M 0.0k 27.2M 27.0M 0.0k nvme4n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.30 2.7M 2.8M 0.0k 26.8M 28.1M 0.0k nvme52n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.20 2.8M 2.8M 0.0k 28.4M 27.6M 0.0k nvme56n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 195.40 2.8M 2.9M 0.0k 28.4M 28.7M 0.0k nvme60n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.90 2.8M 2.8M 0.0k 27.6M 28.0M 0.0k nvme64n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 186.20 2.5M 2.7M 0.0k 24.9M 26.5M 0.0k nvme8n3 2026-02-18T03:48:51.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:48:51.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.541110] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.548364] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.548412] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.763865] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.774335] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.774373] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.942884] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:51] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.950561] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:48:52.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:51 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:51.950598] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:52.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:52.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:52.415 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.138665] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.143248] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.143287] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.290962] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.306271] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.306321] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:52.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.465224] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.469870] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.469907] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:52.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.623079] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:48:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.627612] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:48:52.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.627638] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.780488] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.785688] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.785728] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.926940] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:52] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:48:53.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.933381] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:48:53.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:52 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:52.933414] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:48:52] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.031 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.032 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.033 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:48:53.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.034 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.035 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:48:53.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.037 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49824 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.639964] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000241 seconds 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.655894] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000238 seconds 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.671943] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000277 seconds 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.687876] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000209 seconds 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.703913] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000243 seconds 2026-02-18T03:48:53.038 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.719915] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000253 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.736012] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000348 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.747998] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000235 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.759822] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000180 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.775911] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000253 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.791915] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000251 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.807940] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000258 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.823849] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000200 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.847896] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000228 seconds 2026-02-18T03:48:53.039 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:52 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:48:52.863888] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000234 seconds 2026-02-18T03:48:53.280 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:53 trial155 ceph-mon[104170]: pgmap v782: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.23k op/s 2026-02-18T03:48:53.287 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-mon[109579]: pgmap v782: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.23k op/s 2026-02-18T03:48:53.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.109349] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.118208] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.118247] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.269820] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.286337] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:48:53.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.286396] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:53 trial086 ceph-mon[98535]: pgmap v782: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.23k op/s 2026-02-18T03:48:53.577 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.577 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.439335] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.456132] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.456192] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.578 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.645099] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:53.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:48:53.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.652485] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:48:53.863 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.652524] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:53.864 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:53.864 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:53.864 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.862101] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.121 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:48:54.121 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.871307] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:53.871351] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:53] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.013179] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.017718] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.017744] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.176316] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.183497] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.183538] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.381 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.379698] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.388285] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.388323] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.571055] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.581769] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.581810] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:54.677 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.752947] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:54.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:48:54.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.762383] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:48:54.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.762437] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:54.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:54.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:54.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.932099] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:55.212 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-mon[109579]: pgmap v783: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 3.80k op/s 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:54] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.938999] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:54.939038] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.085930] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:55.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:48:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.091889] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:48:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.091925] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:48:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:55.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:55 trial086 ceph-mon[98535]: pgmap v783: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 3.80k op/s 2026-02-18T03:48:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:55 trial155 ceph-mon[104170]: pgmap v783: 33 pgs: 33 active+clean; 16 GiB data, 55 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 47 MiB/s wr, 3.80k op/s 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.274636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.286096] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.286142] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.444894] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:55.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:48:55.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.450194] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:48:55.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.450233] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.595679] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.600627] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.600652] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:48:55.712180] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.34 port 4420 *** 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:55.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:48:56.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:48:56.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:48:55 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:48:55] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:48:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:57 trial086 ceph-mon[98535]: pgmap v784: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.83k op/s 2026-02-18T03:48:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:57 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3066767328' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:57 trial155 ceph-mon[104170]: pgmap v784: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.83k op/s 2026-02-18T03:48:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:57 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3066767328' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:57 trial034 ceph-mon[109579]: pgmap v784: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 44 MiB/s wr, 3.83k op/s 2026-02-18T03:48:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:57 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/3066767328' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4206275101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2644833705' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:58 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3865605446' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:58 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4206275101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:58 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2644833705' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:58 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3865605446' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4206275101' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2644833705' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:58.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:58 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/3865605446' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:48:59.314 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-mon[98535]: pgmap v785: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.32k op/s 2026-02-18T03:48:59.314 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:48:59] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:48:59.315 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:48:59.316 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49280 2026-02-18T03:48:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:48:59 trial155 ceph-mon[104170]: pgmap v785: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.32k op/s 2026-02-18T03:48:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:48:59 trial034 ceph-mon[109579]: pgmap v785: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.32k op/s 2026-02-18T03:49:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:01 trial086 ceph-mon[98535]: pgmap v786: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 4.22k op/s 2026-02-18T03:49:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:01 trial155 ceph-mon[104170]: pgmap v786: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 4.22k op/s 2026-02-18T03:49:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:01 trial034 ceph-mon[109579]: pgmap v786: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 48 MiB/s wr, 4.22k op/s 2026-02-18T03:49:01.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:01.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.6M 2.5M 0.0k 26.3M 25.4M 0.0k nvme12n3 2026-02-18T03:49:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.00 2.4M 2.7M 0.0k 24.1M 26.9M 0.0k nvme16n3 2026-02-18T03:49:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.60 2.7M 2.7M 0.0k 26.6M 27.1M 0.0k nvme20n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.40 2.8M 2.7M 0.0k 27.5M 26.6M 0.0k nvme24n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.6M 2.7M 0.0k 26.3M 26.8M 0.0k nvme28n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.20 2.5M 2.6M 0.0k 25.4M 25.7M 0.0k nvme32n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.5M 2.6M 0.0k 25.5M 26.4M 0.0k nvme36n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 2.6M 2.6M 0.0k 26.0M 25.6M 0.0k nvme40n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.6M 2.6M 0.0k 25.6M 25.9M 0.0k nvme44n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 2.6M 2.4M 0.0k 26.3M 24.0M 0.0k nvme48n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.8M 2.6M 0.0k 28.3M 25.6M 0.0k nvme4n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.7M 2.6M 0.0k 26.8M 26.0M 0.0k nvme52n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 2.7M 2.7M 0.0k 27.5M 26.6M 0.0k nvme56n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.7M 2.7M 0.0k 27.2M 26.7M 0.0k nvme60n3 2026-02-18T03:49:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.00 2.8M 2.7M 0.0k 27.7M 26.7M 0.0k nvme64n3 2026-02-18T03:49:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.8M 2.7M 0.0k 28.5M 26.6M 0.0k nvme8n3 2026-02-18T03:49:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:49:02] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:49:02.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 1 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: ], , client address: IPv4 10.20.193.34:36658 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.056292] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000189 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.072249] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000214 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.089018] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000973 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.104279] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000248 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.120331] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000301 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.136287] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000263 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.152296] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000238 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.168271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000230 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.184266] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000226 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.200236] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000212 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.216256] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000236 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.232297] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000269 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.248217] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000175 seconds 2026-02-18T03:49:02.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.264266] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000220 seconds 2026-02-18T03:49:03.311 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:03 trial155 ceph-mon[104170]: pgmap v787: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.44k op/s 2026-02-18T03:49:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:03 trial086 ceph-mon[98535]: pgmap v787: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.44k op/s 2026-02-18T03:49:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:03 trial034 ceph-mon[109579]: pgmap v787: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.44k op/s 2026-02-18T03:49:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:04 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1099649025' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:04 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1099649025' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:04 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1099649025' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:04.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:49:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:04.173715] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:49:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:05 trial086 ceph-mon[98535]: pgmap v788: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.83k op/s 2026-02-18T03:49:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1997564578' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4189488435' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:05 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/997972663' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:05 trial155 ceph-mon[104170]: pgmap v788: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.83k op/s 2026-02-18T03:49:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:05 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1997564578' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:05 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4189488435' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:05 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/997972663' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:05 trial034 ceph-mon[109579]: pgmap v788: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.83k op/s 2026-02-18T03:49:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1997564578' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4189488435' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:05 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/997972663' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:07 trial086 ceph-mon[98535]: pgmap v789: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 3.56k op/s 2026-02-18T03:49:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:07 trial155 ceph-mon[104170]: pgmap v789: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 3.56k op/s 2026-02-18T03:49:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:07 trial034 ceph-mon[109579]: pgmap v789: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 44 MiB/s rd, 43 MiB/s wr, 3.56k op/s 2026-02-18T03:49:09.343 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:09 trial086 ceph-mon[98535]: pgmap v790: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.92k op/s 2026-02-18T03:49:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:09 trial155 ceph-mon[104170]: pgmap v790: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.92k op/s 2026-02-18T03:49:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:09 trial034 ceph-mon[109579]: pgmap v790: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 2.92k op/s 2026-02-18T03:49:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:11 trial034 ceph-mon[109579]: pgmap v791: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:49:11.323 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:11 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1492606954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:11 trial086 ceph-mon[98535]: pgmap v791: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:49:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:11 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1492606954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:11 trial155 ceph-mon[104170]: pgmap v791: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 48 MiB/s rd, 47 MiB/s wr, 3.75k op/s 2026-02-18T03:49:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:11 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1492606954' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:11.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:11.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 2.5M 2.7M 0.0k 24.6M 27.0M 0.0k nvme12n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.6M 2.6M 0.0k 26.2M 25.7M 0.0k nvme16n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.6M 2.6M 0.0k 25.8M 26.2M 0.0k nvme20n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.6M 2.5M 0.0k 26.5M 25.5M 0.0k nvme24n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 2.7M 2.6M 0.0k 26.5M 26.1M 0.0k nvme28n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.90 2.5M 2.5M 0.0k 25.1M 24.9M 0.0k nvme32n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.50 2.5M 2.6M 0.0k 24.7M 26.3M 0.0k nvme36n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.60 2.6M 2.4M 0.0k 26.5M 24.2M 0.0k nvme40n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.7M 2.6M 0.0k 27.1M 25.9M 0.0k nvme44n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 207.10 2.4M 2.6M 0.0k 24.5M 26.2M 0.0k nvme48n3 2026-02-18T03:49:11.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.5M 2.5M 0.0k 24.7M 25.4M 0.0k nvme4n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 2.7M 2.7M 0.0k 26.7M 26.7M 0.0k nvme52n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 200.40 2.8M 2.6M 0.0k 27.9M 26.4M 0.0k nvme56n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.6M 2.5M 0.0k 25.9M 25.5M 0.0k nvme60n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 193.90 2.5M 2.8M 0.0k 25.4M 27.6M 0.0k nvme64n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.7M 2.6M 0.0k 27.2M 25.7M 0.0k nvme8n3 2026-02-18T03:49:11.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3429455648' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2376987675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:12 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/105652616' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:12 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3429455648' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:12 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2376987675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:12 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/105652616' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3429455648' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2376987675' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:12.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:12 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/105652616' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:13.335 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:13 trial155 ceph-mon[104170]: pgmap v792: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.01k op/s 2026-02-18T03:49:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:13 trial086 ceph-mon[98535]: pgmap v792: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.01k op/s 2026-02-18T03:49:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:13 trial034 ceph-mon[109579]: pgmap v792: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.01k op/s 2026-02-18T03:49:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:15 trial086 ceph-mon[98535]: pgmap v793: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 44 MiB/s wr, 3.46k op/s 2026-02-18T03:49:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:15 trial155 ceph-mon[104170]: pgmap v793: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 44 MiB/s wr, 3.46k op/s 2026-02-18T03:49:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:15 trial034 ceph-mon[109579]: pgmap v793: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 44 MiB/s wr, 3.46k op/s 2026-02-18T03:49:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:17 trial086 ceph-mon[98535]: pgmap v794: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.29k op/s 2026-02-18T03:49:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:17 trial155 ceph-mon[104170]: pgmap v794: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.29k op/s 2026-02-18T03:49:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:17 trial034 ceph-mon[109579]: pgmap v794: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.29k op/s 2026-02-18T03:49:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/321490474' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/321490474' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:18.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:18 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/321490474' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:19 trial086 ceph-mon[98535]: pgmap v795: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.81k op/s 2026-02-18T03:49:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2510247792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4191382556' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1114627907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:19 trial155 ceph-mon[104170]: pgmap v795: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.81k op/s 2026-02-18T03:49:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2510247792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4191382556' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1114627907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:19 trial034 ceph-mon[109579]: pgmap v795: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.81k op/s 2026-02-18T03:49:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:19 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/2510247792' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:19 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/4191382556' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:19 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1114627907' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:21 trial086 ceph-mon[98535]: pgmap v796: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:49:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:21 trial155 ceph-mon[104170]: pgmap v796: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:49:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:21 trial034 ceph-mon[109579]: pgmap v796: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 46 MiB/s rd, 46 MiB/s wr, 3.62k op/s 2026-02-18T03:49:21.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.4M 2.4M 0.0k 23.9M 24.2M 0.0k nvme12n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 205.70 2.6M 2.5M 0.0k 26.5M 25.3M 0.0k nvme16n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.90 2.6M 2.5M 0.0k 25.9M 24.7M 0.0k nvme20n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 192.20 2.3M 2.5M 0.0k 22.8M 25.2M 0.0k nvme24n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.50 2.5M 2.5M 0.0k 25.2M 25.1M 0.0k nvme28n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 207.00 2.4M 2.4M 0.0k 24.1M 24.4M 0.0k nvme32n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.60 2.4M 2.5M 0.0k 24.2M 25.4M 0.0k nvme36n3 2026-02-18T03:49:21.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.4M 2.5M 0.0k 23.9M 24.7M 0.0k nvme40n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.7M 2.5M 0.0k 26.8M 24.9M 0.0k nvme44n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.5M 2.5M 0.0k 25.2M 25.0M 0.0k nvme48n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.70 2.6M 2.6M 0.0k 25.9M 26.3M 0.0k nvme4n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 191.50 2.4M 2.4M 0.0k 24.5M 24.4M 0.0k nvme52n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.20 2.5M 2.6M 0.0k 25.3M 25.7M 0.0k nvme56n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.5M 2.5M 0.0k 25.5M 25.2M 0.0k nvme60n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.7M 2.6M 0.0k 26.9M 26.2M 0.0k nvme64n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.90 2.5M 2.5M 0.0k 24.9M 25.1M 0.0k nvme8n3 2026-02-18T03:49:21.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:23 trial086 ceph-mon[98535]: pgmap v797: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 2.96k op/s 2026-02-18T03:49:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:23 trial155 ceph-mon[104170]: pgmap v797: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 2.96k op/s 2026-02-18T03:49:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:23 trial034 ceph-mon[109579]: pgmap v797: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 38 MiB/s wr, 2.96k op/s 2026-02-18T03:49:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:25 trial086 ceph-mon[98535]: pgmap v798: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.43k op/s 2026-02-18T03:49:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:25 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1995027214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:25 trial155 ceph-mon[104170]: pgmap v798: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.43k op/s 2026-02-18T03:49:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:25 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1995027214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:25.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:25 trial034 ceph-mon[109579]: pgmap v798: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.43k op/s 2026-02-18T03:49:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:25 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1995027214' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1246156871' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3035893303' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/828306995' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1246156871' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3035893303' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/828306995' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1246156871' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3035893303' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:26.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:26 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/828306995' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:27 trial086 ceph-mon[98535]: pgmap v799: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:49:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:27 trial155 ceph-mon[104170]: pgmap v799: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:49:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:27 trial034 ceph-mon[109579]: pgmap v799: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 41 MiB/s wr, 3.28k op/s 2026-02-18T03:49:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:29 trial086 ceph-mon[98535]: pgmap v800: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.83k op/s 2026-02-18T03:49:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:29 trial155 ceph-mon[104170]: pgmap v800: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.83k op/s 2026-02-18T03:49:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:29 trial034 ceph-mon[109579]: pgmap v800: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.83k op/s 2026-02-18T03:49:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:31 trial086 ceph-mon[98535]: pgmap v801: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.63k op/s 2026-02-18T03:49:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:31 trial155 ceph-mon[104170]: pgmap v801: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.63k op/s 2026-02-18T03:49:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:31 trial034 ceph-mon[109579]: pgmap v801: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 45 MiB/s rd, 45 MiB/s wr, 3.63k op/s 2026-02-18T03:49:31.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.30 2.4M 2.4M 0.0k 23.7M 24.2M 0.0k nvme12n3 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.90 2.4M 2.4M 0.0k 24.2M 23.8M 0.0k nvme16n3 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.20 2.4M 2.4M 0.0k 24.1M 24.2M 0.0k nvme20n3 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 193.50 2.3M 2.5M 0.0k 22.5M 25.2M 0.0k nvme24n3 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.00 2.6M 2.5M 0.0k 25.7M 24.6M 0.0k nvme28n3 2026-02-18T03:49:31.739 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.3M 2.3M 0.0k 23.1M 22.9M 0.0k nvme32n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.4M 2.4M 0.0k 23.7M 23.8M 0.0k nvme36n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.3M 2.4M 0.0k 23.1M 24.0M 0.0k nvme40n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.50 2.4M 2.5M 0.0k 24.4M 25.1M 0.0k nvme44n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.00 2.3M 2.4M 0.0k 23.3M 23.7M 0.0k nvme48n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.5M 2.5M 0.0k 25.3M 24.8M 0.0k nvme4n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 189.90 2.3M 2.5M 0.0k 22.8M 24.6M 0.0k nvme52n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 194.60 2.4M 2.4M 0.0k 24.1M 24.2M 0.0k nvme56n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.70 2.3M 2.4M 0.0k 23.4M 23.5M 0.0k nvme60n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.50 2.6M 2.5M 0.0k 25.7M 25.0M 0.0k nvme64n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 204.60 2.7M 2.6M 0.0k 27.0M 25.9M 0.0k nvme8n3 2026-02-18T03:49:31.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:32.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:32 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2504141740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:32.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:32 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2504141740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:32.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:32 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2504141740' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:33 trial086 ceph-mon[98535]: pgmap v802: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:49:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/157626765' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3321999335' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/999597241' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:33 trial155 ceph-mon[104170]: pgmap v802: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:49:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/157626765' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3321999335' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/999597241' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:33 trial034 ceph-mon[109579]: pgmap v802: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 36 MiB/s wr, 2.98k op/s 2026-02-18T03:49:33.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/157626765' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3321999335' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:33.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:33 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/999597241' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:35 trial086 ceph-mon[98535]: pgmap v803: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.43k op/s 2026-02-18T03:49:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:35 trial155 ceph-mon[104170]: pgmap v803: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.43k op/s 2026-02-18T03:49:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:35 trial034 ceph-mon[109579]: pgmap v803: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 42 MiB/s rd, 42 MiB/s wr, 3.43k op/s 2026-02-18T03:49:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:37 trial086 ceph-mon[98535]: pgmap v804: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.27k op/s 2026-02-18T03:49:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:37 trial155 ceph-mon[104170]: pgmap v804: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.27k op/s 2026-02-18T03:49:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:37 trial034 ceph-mon[109579]: pgmap v804: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 40 MiB/s wr, 3.27k op/s 2026-02-18T03:49:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:39 trial086 ceph-mon[98535]: pgmap v805: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.81k op/s 2026-02-18T03:49:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1194474603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:39 trial155 ceph-mon[104170]: pgmap v805: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.81k op/s 2026-02-18T03:49:39.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:39 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1194474603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:39 trial034 ceph-mon[109579]: pgmap v805: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 34 MiB/s wr, 2.81k op/s 2026-02-18T03:49:39.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:39 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/1194474603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3687615265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2377791955' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4130773534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3687615265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2377791955' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4130773534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3687615265' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/2377791955' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:40.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:40 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4130773534' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:41 trial086 ceph-mon[98535]: pgmap v806: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.60k op/s 2026-02-18T03:49:41.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:41 trial034 ceph-mon[109579]: pgmap v806: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.60k op/s 2026-02-18T03:49:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:41 trial155 ceph-mon[104170]: pgmap v806: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 43 MiB/s rd, 43 MiB/s wr, 3.60k op/s 2026-02-18T03:49:41.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:41.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.80 2.4M 2.4M 0.0k 24.2M 24.3M 0.0k nvme12n3 2026-02-18T03:49:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 200.60 2.4M 2.5M 0.0k 23.5M 24.8M 0.0k nvme16n3 2026-02-18T03:49:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.2M 2.4M 0.0k 22.5M 24.0M 0.0k nvme20n3 2026-02-18T03:49:41.739 INFO:tasks.workunit.client.0.trial014.stdout: 198.80 2.4M 2.4M 0.0k 23.8M 23.8M 0.0k nvme24n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.50 2.4M 2.3M 0.0k 24.1M 23.0M 0.0k nvme28n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 206.10 2.3M 2.3M 0.0k 22.7M 22.6M 0.0k nvme32n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.90 2.2M 2.4M 0.0k 22.5M 23.9M 0.0k nvme36n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 203.30 2.3M 2.3M 0.0k 23.0M 23.2M 0.0k nvme40n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.4M 2.3M 0.0k 24.0M 23.1M 0.0k nvme44n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.20 2.4M 2.1M 0.0k 23.6M 21.3M 0.0k nvme48n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.20 2.3M 2.3M 0.0k 23.3M 23.1M 0.0k nvme4n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 196.50 2.3M 2.4M 0.0k 23.3M 24.3M 0.0k nvme52n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 195.10 2.3M 2.3M 0.0k 22.8M 23.4M 0.0k nvme56n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.70 2.4M 2.4M 0.0k 23.9M 23.7M 0.0k nvme60n3 2026-02-18T03:49:41.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.20 2.3M 2.5M 0.0k 23.4M 25.2M 0.0k nvme64n3 2026-02-18T03:49:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.10 2.3M 2.3M 0.0k 22.7M 23.3M 0.0k nvme8n3 2026-02-18T03:49:41.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:42 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:49:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:42 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:49:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:42 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:49:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:42 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:49:42.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:42 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:49:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:42 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:49:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:42 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:49:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:42 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:49:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:42 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:49:42.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:42 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:49:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:42 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:49:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:42 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:49:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:42 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:49:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:42 trial034 ceph-mon[109579]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:49:42.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:42 trial034 ceph-mon[109579]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:49:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:43 trial086 ceph-mon[98535]: pgmap v807: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.97k op/s 2026-02-18T03:49:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:43 trial155 ceph-mon[104170]: pgmap v807: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.97k op/s 2026-02-18T03:49:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:43 trial034 ceph-mon[109579]: pgmap v807: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 35 MiB/s wr, 2.97k op/s 2026-02-18T03:49:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:45 trial086 ceph-mon[98535]: pgmap v808: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.43k op/s 2026-02-18T03:49:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:45 trial155 ceph-mon[104170]: pgmap v808: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.43k op/s 2026-02-18T03:49:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:45 trial034 ceph-mon[109579]: pgmap v808: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.43k op/s 2026-02-18T03:49:46.093 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:49:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2026128408' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:46.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:46 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2026128408' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:46.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:46 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2026128408' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:47 trial086 ceph-mon[98535]: pgmap v809: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.27k op/s 2026-02-18T03:49:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2232542310' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1622627273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1344029394' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:47 trial155 ceph-mon[104170]: pgmap v809: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.27k op/s 2026-02-18T03:49:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2232542310' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1622627273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1344029394' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:47 trial034 ceph-mon[109579]: pgmap v809: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.27k op/s 2026-02-18T03:49:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2232542310' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1622627273' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:47 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1344029394' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:49 trial155 ceph-mon[104170]: pgmap v810: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.80k op/s 2026-02-18T03:49:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:49 trial034 ceph-mon[109579]: pgmap v810: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.80k op/s 2026-02-18T03:49:49.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:49 trial086 ceph-mon[98535]: pgmap v810: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 32 MiB/s rd, 33 MiB/s wr, 2.80k op/s 2026-02-18T03:49:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:51 trial155 ceph-mon[104170]: pgmap v811: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.60k op/s 2026-02-18T03:49:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:51 trial034 ceph-mon[109579]: pgmap v811: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.60k op/s 2026-02-18T03:49:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:51 trial086 ceph-mon[98535]: pgmap v811: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 41 MiB/s rd, 42 MiB/s wr, 3.60k op/s 2026-02-18T03:49:51.735 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 202.10 2.3M 2.3M 0.0k 23.5M 22.7M 0.0k nvme12n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.30 2.3M 2.3M 0.0k 23.4M 22.5M 0.0k nvme16n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 196.80 2.2M 2.3M 0.0k 22.0M 22.5M 0.0k nvme20n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 2.3M 2.4M 0.0k 22.6M 24.2M 0.0k nvme24n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 192.40 2.2M 2.3M 0.0k 21.9M 23.2M 0.0k nvme28n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 205.50 2.2M 2.2M 0.0k 21.8M 21.7M 0.0k nvme32n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 197.40 2.2M 2.3M 0.0k 21.8M 22.6M 0.0k nvme36n3 2026-02-18T03:49:51.741 INFO:tasks.workunit.client.0.trial014.stdout: 201.70 2.3M 2.2M 0.0k 22.9M 21.6M 0.0k nvme40n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 194.10 2.3M 2.2M 0.0k 23.4M 22.3M 0.0k nvme44n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 203.70 2.4M 2.2M 0.0k 23.7M 22.1M 0.0k nvme48n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 194.50 2.1M 2.3M 0.0k 21.1M 22.7M 0.0k nvme4n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 189.40 2.1M 2.2M 0.0k 20.6M 22.4M 0.0k nvme52n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 194.00 2.2M 2.3M 0.0k 21.6M 23.4M 0.0k nvme56n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 195.50 2.4M 2.2M 0.0k 23.5M 22.5M 0.0k nvme60n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 195.60 2.3M 2.5M 0.0k 23.1M 24.8M 0.0k nvme64n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 200.10 2.4M 2.4M 0.0k 23.9M 24.3M 0.0k nvme8n3 2026-02-18T03:49:51.742 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:49:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:53 trial155 ceph-mon[104170]: pgmap v812: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.95k op/s 2026-02-18T03:49:53.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:53 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2787764375' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:53 trial034 ceph-mon[109579]: pgmap v812: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.95k op/s 2026-02-18T03:49:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:53 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/2787764375' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:53.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:53 trial086 ceph-mon[98535]: pgmap v812: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 34 MiB/s rd, 34 MiB/s wr, 2.95k op/s 2026-02-18T03:49:53.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:53 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2787764375' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3116091948' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/482712500' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/157535076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/3116091948' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/482712500' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:54 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/157535076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3116091948' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/482712500' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:54.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/157535076' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:49:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:55 trial155 ceph-mon[104170]: pgmap v813: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.39k op/s 2026-02-18T03:49:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:55 trial034 ceph-mon[109579]: pgmap v813: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.39k op/s 2026-02-18T03:49:55.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:55 trial086 ceph-mon[98535]: pgmap v813: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 39 MiB/s rd, 39 MiB/s wr, 3.39k op/s 2026-02-18T03:49:57.424 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:57 trial086 ceph-mon[98535]: pgmap v814: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.24k op/s 2026-02-18T03:49:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:57 trial155 ceph-mon[104170]: pgmap v814: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.24k op/s 2026-02-18T03:49:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:57 trial034 ceph-mon[109579]: pgmap v814: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.24k op/s 2026-02-18T03:49:58.523 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:49:58.524 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:49:58.524 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:48:41 UTC; 1min 17s ago 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114053 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114054 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 114131 (conmon) 2026-02-18T03:49:58.553 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 322.5M (peak: 325.4M) 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 5min 2.957s 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114133 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114135 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114251 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114525 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:49:58.554 INFO:teuthology.orchestra.run.trial034.stdout: │ └─114542 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout: └─114131 /usr/bin/conmon --api-version 1 -c 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -u 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata -p /run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.136287] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000263 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.152296] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000238 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.168271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000230 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.184266] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000226 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.200236] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000212 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.216256] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000236 seconds 2026-02-18T03:49:58.555 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.232297] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000269 seconds 2026-02-18T03:49:58.556 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.248217] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000175 seconds 2026-02-18T03:49:58.556 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:02 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:02.264266] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000220 seconds 2026-02-18T03:49:58.556 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:49:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:49:04.173715] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:49:58.557 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:49:58.589 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 10min ago 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 356.6M (peak: 359.9M) 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 40min 8.354s 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:49:58.590 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:49:58.591 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:49:58.592 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49280 2026-02-18T03:49:58.593 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:49:58.631 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:49:58.631 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:44:19 UTC; 5min ago 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91482 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91483 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 91554 (conmon) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 346.5M (peak: 352.8M) 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 22min 24.704s 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:49:58.632 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91556 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91558 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─91650 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─92256 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: │ └─92321 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: └─91554 /usr/bin/conmon --api-version 1 -c 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -u 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata -p /run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.762675] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000322 seconds 2026-02-18T03:49:58.633 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.778705] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000343 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.794719] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000331 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.810664] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000283 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.826721] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000335 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.842646] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000267 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:44:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [2026-02-18 03:44:40.858687] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000281 seconds 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:49:58.634 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:48:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:48:22] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:49:58.635 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:49:58.676 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:49:58.676 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:49:58.676 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 7min ago 2026-02-18T03:49:58.676 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.676 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 374.2M (peak: 375.9M) 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 29min 54.652s 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:49:58.677 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:49:58.678 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:49:58.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:49:58.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:49:58.679 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:49:58.680 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:49:58.902 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:49:58.903 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 77s ago 24m trial034=x;count:1 2026-02-18T03:49:58.903 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 10m ago 25m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:49:58.903 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 10m ago 23m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:49:58.903 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 10m ago 23m trial155 2026-02-18T03:49:58.911 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:49:59.092 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:49:59.093 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (78s) 77s ago 14m 56.6M - 1.6.5 99a57256b38c 0a2f92368348 2026-02-18T03:49:59.093 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (10m) 10m ago 14m 57.2M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:49:59.093 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (5m) 4m ago 5m 330M - 1.6.5 99a57256b38c 6656e6ed9326 2026-02-18T03:49:59.093 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (7m) 7m ago 14m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:49:59.101 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:49:59.322 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:49:59.332 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:49:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:49:59 trial155 ceph-mon[104170]: pgmap v815: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 2.77k op/s 2026-02-18T03:49:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:49:59 trial034 ceph-mon[109579]: pgmap v815: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 2.77k op/s 2026-02-18T03:49:59.550 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:49:59.550 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:49:59.550 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:49:59.550 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 77s) [leader: a] 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 25m) 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 23m), 8 in (since 23m) 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: usage: 56 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:49:59.551 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:49:59.552 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:49:59.552 INFO:teuthology.orchestra.run.trial177.stdout: client: 31 MiB/s rd, 32 MiB/s wr, 1.37k op/s rd, 1.40k op/s wr 2026-02-18T03:49:59.552 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:49:59.559 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:49:59.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:49:59 trial086 ceph-mon[98535]: pgmap v815: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 32 MiB/s wr, 2.77k op/s 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 228, 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 2, 2026-02-18T03:49:59.792 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 165, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:49:59.793 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:49:59.794 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:49:59.795 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:49:59.796 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:49:59.802 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:49:59.861 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.862 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.863 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.864 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.865 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.866 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.867 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.868 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.868 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.868 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.868 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.868 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:49:59.869 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:49:59.914 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:49:59.916 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:49:59.961 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:49:59.962 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:50:00.007 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.009 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:50:00.056 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.057 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:50:00.103 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.104 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:50:00.149 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.150 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:50:00.194 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.195 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:50:00.278 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.279 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:50:00.364 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.366 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:50:00.410 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.412 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:50:00.457 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.457 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:50:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.125514 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.136342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/121918744' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:00.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4268518281' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:50:00.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3308241650' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:50:00.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1215911383' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:50:00.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:00 trial155 ceph-mon[104170]: overall HEALTH_OK 2026-02-18T03:50:00.502 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.503 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:50:00.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.125514 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.136342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.? 10.20.193.34:0/121918744' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/4268518281' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3308241650' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/1215911383' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:50:00.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:00 trial034 ceph-mon[109579]: overall HEALTH_OK 2026-02-18T03:50:00.547 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.549 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:50:00.593 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.594 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:50:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.125514 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.136342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/121918744' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4268518281' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:50:00.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3308241650' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:50:00.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1215911383' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:50:00.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:00 trial086 ceph-mon[98535]: overall HEALTH_OK 2026-02-18T03:50:00.640 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.641 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:50:00.687 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.687 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:50:00.733 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.734 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:50:00.779 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.780 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:50:00.825 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.826 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:50:00.870 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.871 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:50:00.916 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.917 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:50:00.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:00.962 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:50:01.008 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.009 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:50:01.053 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.054 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:50:01.099 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.100 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:50:01.147 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.148 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:50:01.191 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.193 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:50:01.238 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.238 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:50:01.282 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.284 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:50:01.328 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.329 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:50:01.373 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.374 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:50:01.420 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.420 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:50:01.465 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.466 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:50:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:01 trial155 ceph-mon[104170]: pgmap v816: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.58k op/s 2026-02-18T03:50:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2898380041' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1831054610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3748086452' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.511 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.512 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:50:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:01 trial034 ceph-mon[109579]: pgmap v816: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.58k op/s 2026-02-18T03:50:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.86:0/2898380041' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.155:0/1831054610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:01 trial034 ceph-mon[109579]: from='client.? 10.20.193.177:0/3748086452' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.556 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.557 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:50:01.602 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.602 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:50:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:01 trial086 ceph-mon[98535]: pgmap v816: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 41 MiB/s wr, 3.58k op/s 2026-02-18T03:50:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2898380041' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1831054610' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3748086452' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:01.686 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.687 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:50:01.733 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.734 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 191.60 2.0M 2.3M 0.0k 19.7M 23.1M 0.0k nvme12n3 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 206.80 2.3M 2.2M 0.0k 23.3M 22.1M 0.0k nvme16n3 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 199.70 2.3M 2.2M 0.0k 22.6M 22.0M 0.0k nvme20n3 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 201.50 2.3M 2.2M 0.0k 23.0M 22.1M 0.0k nvme24n3 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 189.60 2.1M 2.2M 0.0k 20.9M 21.9M 0.0k nvme28n3 2026-02-18T03:50:01.739 INFO:tasks.workunit.client.0.trial014.stdout: 204.20 2.1M 2.3M 0.0k 20.7M 22.6M 0.0k nvme32n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.10 2.2M 2.3M 0.0k 22.2M 23.1M 0.0k nvme36n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 205.20 2.3M 2.2M 0.0k 23.2M 22.4M 0.0k nvme40n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.3M 2.2M 0.0k 23.0M 22.2M 0.0k nvme44n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 200.90 2.0M 2.1M 0.0k 20.4M 21.0M 0.0k nvme48n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 198.90 2.3M 2.1M 0.0k 23.1M 21.2M 0.0k nvme4n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 197.80 2.2M 2.4M 0.0k 22.2M 23.6M 0.0k nvme52n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 190.60 2.0M 2.3M 0.0k 20.4M 23.3M 0.0k nvme56n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 190.90 2.2M 2.3M 0.0k 21.6M 22.8M 0.0k nvme60n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 201.00 2.5M 2.4M 0.0k 24.5M 23.6M 0.0k nvme64n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 202.30 2.3M 2.3M 0.0k 22.9M 22.9M 0.0k nvme8n3 2026-02-18T03:50:01.740 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:01.741 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:01.779 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.780 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:50:01.823 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.825 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:50:01.910 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.910 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:50:01.955 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:01.956 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:50:02.003 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.003 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:50:02.049 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.050 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:50:02.095 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.096 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:50:02.142 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.142 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:50:02.188 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.189 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:50:02.235 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.236 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:50:02.279 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.280 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:50:02.326 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.327 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:50:02.371 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.372 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:50:02.416 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.417 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:50:02.503 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.504 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:50:02.549 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.551 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:50:02.596 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.597 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:50:02.642 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.643 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:50:02.689 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.690 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:50:02.735 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.736 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:50:02.780 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.782 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:50:02.826 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.827 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:50:02.871 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.873 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:50:02.958 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:02.959 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:50:03.003 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:03.004 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:50:03.090 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:50:03.091 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: waiting for other thrasher 2026-02-18T03:50:03.091 INFO:tasks.nvmeof.[nvmeof.thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:50:03.092 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:50:03.092 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:50:03.092 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.c 2026-02-18T03:50:03.092 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon stop nvmeof.nvmeof.c 2026-02-18T03:50:03.092 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:50:03.093 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:50:03.093 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:50:03.339 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":81,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:50:03.351 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:50:03.351 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:making sure all monitors are in the quorum 2026-02-18T03:50:03.351 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:50:03.351 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:50:03.371 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 ceph-mon[109579]: pgmap v817: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.96k op/s 2026-02-18T03:50:03.400 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to stop nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:50:03.411 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:50:03.411 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 68 secs before reviving 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 440843, 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:50:03.431 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.432 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:50:03.433 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.434 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:50:03.435 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.436 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:50:03.437 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.438 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.439 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.440 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.441 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:50:03.442 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.443 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.444 INFO:teuthology.orchestra.run.trial034.stdout: "num": 74 2026-02-18T03:50:03.445 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.445 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.445 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.445 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:50:03.445 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:50:03.446 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:50:03.447 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:50:03.447 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:50:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:03 trial155 ceph-mon[104170]: pgmap v817: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.96k op/s 2026-02-18T03:50:03.563 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:03 trial086 ceph-mon[98535]: pgmap v817: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 2.96k op/s 2026-02-18T03:50:03.565 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:50:03.565 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:03.565 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:03.565 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:50:03.565 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 611623, 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.566 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.567 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.568 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:50:03.569 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.570 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:50:03.571 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.572 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.573 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:50:03.574 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:03.575 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.576 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.577 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:50:03.578 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "num": 73 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.579 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.580 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:50:03.580 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:50:03.581 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:50:03.581 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:50:03.582 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:50:03.660 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:50:03.660 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 56, 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 83092, 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.661 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 81, 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.662 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.663 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:50:03.664 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:50:03.665 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:03.666 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.667 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.668 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.669 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.670 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:50:03.671 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:03.672 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:03.673 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:50:03.674 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:50:03.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:50:03.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to thrash: ['a'] 2026-02-18T03:50:03.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:monitors to freeze: [] 2026-02-18T03:50:03.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:thrashing mon.a 2026-02-18T03:50:03.676 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:killing mon.a 2026-02-18T03:50:03.676 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-18T03:50:03.677 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:50:03.898 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service' 2026-02-18T03:50:03.918 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 systemd[1]: Stopping Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:50:03.918 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[109554]: 2026-02-18T03:50:03.785+0000 7fae5eac3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:50:03.918 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[109554]: 2026-02-18T03:50:03.785+0000 7fae5eac3640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 podman[124724]: 2026-02-18 03:50:03.8068793 +0000 UTC m=+0.034005547 container died 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS) 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 podman[124724]: 2026-02-18 03:50:03.816688572 +0000 UTC m=+0.043814819 container remove 05564333f87945987155e77327ca7e5dc4914b44b1edfa640894973f1a01f5cc (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.schema-version=1.0) 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 bash[124724]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 systemd[1]: Stopped Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:50:03.919 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:50:03 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service: Consumed 6.494s CPU time. 2026-02-18T03:50:03.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:50:03.933 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-18T03:50:03.934 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-18T03:50:03.934 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:50:04.230 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":82,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:50:07.242 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:50:07.491 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":85,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:50:10.505 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:50:10.761 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":88,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:50:13.772 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:50:14.334 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout:job-/dev/nvme36n3: (groupid=0, jobs=16): err= 0: pid=56782: Wed Feb 18 03:50:14 2026 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: read: IOPS=1614, BW=38.9MiB/s (40.8MB/s)(45.6GiB/1200007msec) 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: clat (usec): min=55, max=30839k, avg=1438.60, stdev=63306.93 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: lat (usec): min=55, max=30839k, avg=1438.66, stdev=63306.93 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: clat percentiles (usec): 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: | 1.00th=[ 293], 5.00th=[ 338], 10.00th=[ 375], 20.00th=[ 437], 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: | 30.00th=[ 478], 40.00th=[ 515], 50.00th=[ 562], 60.00th=[ 611], 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: | 70.00th=[ 701], 80.00th=[ 1418], 90.00th=[ 3556], 95.00th=[ 4883], 2026-02-18T03:50:14.335 INFO:tasks.workunit.client.0.trial014.stdout: | 99.00th=[ 7898], 99.50th=[ 9372], 99.90th=[12911], 99.95th=[14615], 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: | 99.99th=[18482] 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: bw ( KiB/s): min= 4012, max=266728, per=100.00%, avg=43398.13, stdev=1400.63, samples=35294 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: iops : min= 223, max= 8132, avg=1756.15, stdev=43.52, samples=35294 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: write: IOPS=1616, BW=39.0MiB/s (40.9MB/s)(45.7GiB/1200007msec); 0 zone resets 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: clat (usec): min=787, max=30853k, avg=8427.19, stdev=108644.72 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: lat (usec): min=791, max=30853k, avg=8457.29, stdev=108644.89 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: clat percentiles (usec): 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: | 1.00th=[ 1401], 5.00th=[ 2540], 10.00th=[ 3949], 20.00th=[ 5276], 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: | 30.00th=[ 5735], 40.00th=[ 6063], 50.00th=[ 6915], 60.00th=[ 8160], 2026-02-18T03:50:14.336 INFO:tasks.workunit.client.0.trial014.stdout: | 70.00th=[ 9372], 80.00th=[10552], 90.00th=[12649], 95.00th=[14746], 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: | 99.00th=[19006], 99.50th=[20841], 99.90th=[25035], 99.95th=[26870], 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: | 99.99th=[38011] 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: bw ( KiB/s): min= 6173, max=262088, per=100.00%, avg=43487.84, stdev=1335.37, samples=35293 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: iops : min= 292, max= 7766, avg=1758.84, stdev=39.90, samples=35293 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: lat (usec) : 100=0.03%, 250=0.08%, 500=18.00%, 750=18.47%, 1000=2.10% 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: lat (msec) : 2=4.41%, 4=7.84%, 10=36.83%, 20=11.89%, 50=0.34% 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: lat (msec) : 100=0.01%, 250=0.01%, >=2000=0.01% 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: cpu : usr=0.36%, sys=0.07%, ctx=3997830, majf=0, minf=53255 2026-02-18T03:50:14.337 INFO:tasks.workunit.client.0.trial014.stdout: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: issued rwts: total=1937346,1940287,0,0 short=0,0,0,0 dropped=0,0,0,0 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: latency : target=0, window=0, percentile=100.00%, depth=1 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout:Run status group 0 (all jobs): 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: READ: bw=38.9MiB/s (40.8MB/s), 38.9MiB/s-38.9MiB/s (40.8MB/s-40.8MB/s), io=45.6GiB (49.0GB), run=1200007-1200007msec 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: WRITE: bw=39.0MiB/s (40.9MB/s), 39.0MiB/s-39.0MiB/s (40.9MB/s-40.9MB/s), io=45.7GiB (49.1GB), run=1200007-1200007msec 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout: 2026-02-18T03:50:14.338 INFO:tasks.workunit.client.0.trial014.stdout:Disk stats (read/write): 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme36n3: ios=121721/121454, merge=0/0, ticks=148218/946972, in_queue=1095190, util=91.18% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme40n3: ios=121368/121744, merge=0/0, ticks=144850/950096, in_queue=1094946, util=91.18% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme28n3: ios=120804/120492, merge=0/0, ticks=150799/944354, in_queue=1095153, util=91.21% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme32n3: ios=123430/123888, merge=0/0, ticks=146535/948713, in_queue=1095248, util=91.22% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme64n3: ios=120128/120235, merge=0/0, ticks=146631/948161, in_queue=1094792, util=91.19% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme48n3: ios=123114/122632, merge=0/0, ticks=145158/949640, in_queue=1094798, util=91.19% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme44n3: ios=121157/121031, merge=0/0, ticks=145701/949337, in_queue=1095038, util=91.21% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme60n3: ios=120485/120254, merge=0/0, ticks=149609/945170, in_queue=1094779, util=91.21% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme16n3: ios=121003/121675, merge=0/0, ticks=145754/949460, in_queue=1095214, util=91.26% 2026-02-18T03:50:14.339 INFO:tasks.workunit.client.0.trial014.stdout: nvme24n3: ios=120819/120276, merge=0/0, ticks=150176/945057, in_queue=1095233, util=91.27% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme8n3: ios=121017/121050, merge=0/0, ticks=147516/947769, in_queue=1095285, util=91.29% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme4n3: ios=120632/120860, merge=0/0, ticks=146056/949317, in_queue=1095373, util=91.30% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme56n3: ios=120155/120495, merge=0/0, ticks=147410/947504, in_queue=1094914, util=91.27% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme20n3: ios=121180/121921, merge=0/0, ticks=144831/950472, in_queue=1095303, util=91.30% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme52n3: ios=120023/119973, merge=0/0, ticks=148483/946388, in_queue=1094871, util=91.28% 2026-02-18T03:50:14.340 INFO:tasks.workunit.client.0.trial014.stdout: nvme12n3: ios=122013/122017, merge=0/0, ticks=145278/949893, in_queue=1095171, util=91.32% 2026-02-18T03:50:14.341 INFO:tasks.workunit.client.0.trial014.stderr:+ '[' 0 -ne 0 ']' 2026-02-18T03:50:14.342 INFO:tasks.workunit.client.0.trial014.stdout:[nvmeof.fio] fio test successful! 2026-02-18T03:50:14.343 INFO:tasks.workunit.client.0.trial014.stderr:+ echo '[nvmeof.fio] fio test successful!' 2026-02-18T03:50:14.343 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T03:50:14.343 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T03:50:14.370 INFO:tasks.workunit:Stopping ['nvmeof/fio_test.sh --random_devices 32'] on client.0... 2026-02-18T03:50:14.370 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T03:50:14.727 DEBUG:teuthology.parallel:result is None 2026-02-18T03:50:14.727 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:50:14.752 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:50:14.753 DEBUG:teuthology.orchestra.run.trial014:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T03:50:14.808 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T03:50:14.809 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-18T03:50:14.827 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-18T03:50:18.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:18 trial155 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.136384 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: Schedule stop daemon nvmeof.nvmeof.c 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v818: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.42k op/s 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3763714991' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v819: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.28k op/s 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/4057856801' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2026344454' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3344203560' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/482925815' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3291815983' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v820: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.81k op/s 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v821: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.62k op/s 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1161561521' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v822: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.00k op/s 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/257862816' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: mon.c calling monitor election 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: mon.b calling monitor election 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v823: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.45k op/s 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v824: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 34 MiB/s wr, 3.20k op/s 2026-02-18T03:50:18.715 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: pgmap v825: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.66k op/s 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: monmap epoch 3 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: min_mon_release 20 (tentacle) 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: election_strategy: 1 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: fsmap 2026-02-18T03:50:18.716 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: mgrmap e15: x(active, since 25m) 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='' 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:18.717 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:50:18.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.136384 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: Schedule stop daemon nvmeof.nvmeof.c 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v818: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 38 MiB/s rd, 38 MiB/s wr, 3.42k op/s 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3763714991' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v819: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 36 MiB/s rd, 37 MiB/s wr, 3.28k op/s 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4057856801' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2026344454' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3344203560' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/482925815' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3291815983' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v820: 33 pgs: 33 active+clean; 16 GiB data, 57 GiB used, 5.4 TiB / 5.5 TiB avail; 31 MiB/s rd, 31 MiB/s wr, 2.81k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v821: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 40 MiB/s rd, 40 MiB/s wr, 3.62k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1161561521' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v822: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 33 MiB/s rd, 33 MiB/s wr, 3.00k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/257862816' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v823: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 37 MiB/s rd, 37 MiB/s wr, 3.45k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v824: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 35 MiB/s rd, 34 MiB/s wr, 3.20k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: pgmap v825: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.66k op/s 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:50:18.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 25m) 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: Health check failed: 1/3 mons down, quorum c,b (MON_DOWN) 2026-02-18T03:50:18.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='' 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:18.877 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:50:18.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:18] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:50:18.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:18] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:50:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:18] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.155:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.155:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:50:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:18] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:50:19.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2799558782' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:19.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1234559297' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:19.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:19 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1953686329' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:19.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2799558782' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:19.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1234559297' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:19.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:19 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1953686329' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:20.015 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":58,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:50:20.027 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-18T03:50:20.027 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon b 2026-02-18T03:50:20.027 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 58, 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 628161, 2026-02-18T03:50:20.103 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.104 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:50:20.105 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.106 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:50:20.107 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.108 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.109 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.110 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:20.111 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.112 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.113 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:50:20.114 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:20.115 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.116 INFO:teuthology.orchestra.run.trial034.stdout: "num": 131 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:50:20.117 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:50:20.119 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:50:20.119 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 2 for mon c 2026-02-18T03:50:20.119 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:50:20.193 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:50:20.193 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 58, 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 99625, 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 1, 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:20.194 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.195 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.196 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:50:20.197 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:50:20.198 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:50:20.199 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.200 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:50:20.201 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.202 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:50:20.203 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.204 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:50:20.205 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:50:20.206 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "num": 13 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:50:20.207 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:50:20.208 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:50:20.208 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:50:20.208 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:50:20.209 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 2 2026-02-18T03:50:20.209 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before reviving monitors 2026-02-18T03:50:20.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: pgmap v826: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.65k op/s 2026-02-18T03:50:20.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3809064135' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:20.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:50:20.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:50:20.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:50:20.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:50:20.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial155) 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 podman[105060]: 2026-02-18 03:50:20.513420268 +0000 UTC m=+1.813700370 container died 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, url=https://github.com/ceph/ceph-nvmeof, release=, vendor=Red Hat, Inc., io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.ceph-release=20.2.0, summary=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, io.ceph.nvmeof=, io.spdk.git.branch=undefined, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, version=1.6.5, build-date=2026-02-11 09:53:49 UTC, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 podman[105060]: 2026-02-18 03:50:20.52503655 +0000 UTC m=+1.825316642 container remove 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, maintainer=Ceph Developers , io.ceph.nvmeof=, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.build.makeflags=, release=, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.spdk.git.branch=undefined, io.ceph.git.branch=devel, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.openshift.wants=ceph,rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, distribution-scope=public, vcs-type=git, io.spdk.version=25.09, io.ceph.maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0) 2026-02-18T03:50:20.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 bash[105060]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:50:20.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:50:20.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:50:20.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 23min 50.174s CPU time, 352.8M memory peak. 2026-02-18T03:50:20.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: pgmap v826: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 29 MiB/s rd, 28 MiB/s wr, 2.65k op/s 2026-02-18T03:50:20.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3809064135' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:50:20.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:50:20.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:50:20.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:50:20.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:20 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:50:21.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:50:21.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:50:21.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:50:21.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:21 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:50:21.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:50:21.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:50:21.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:50:21.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:50:21.979 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:21 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:50:22.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:22 trial086 ceph-mon[98535]: pgmap v827: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 18 MiB/s wr, 1.74k op/s 2026-02-18T03:50:22.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:22 trial155 ceph-mon[104170]: pgmap v827: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 19 MiB/s rd, 18 MiB/s wr, 1.74k op/s 2026-02-18T03:50:25.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:25 trial086 ceph-mon[98535]: pgmap v828: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 14 MiB/s wr, 1.48k op/s 2026-02-18T03:50:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:25 trial155 ceph-mon[104170]: pgmap v828: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 15 MiB/s rd, 14 MiB/s wr, 1.48k op/s 2026-02-18T03:50:26.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:50:25] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:50:26.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:50:26.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:50:26.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: OPTIMIZED 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:50:26.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: ], , client address: IPv4 10.20.193.34:33626 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.584150] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000192 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.600072] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000185 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.616058] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000181 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.632052] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000178 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.648091] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000212 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.672092] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000210 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.692098] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000220 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.708064] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000188 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.724041] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000166 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.740057] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000180 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.756070] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000192 seconds 2026-02-18T03:50:26.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.772076] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000199 seconds 2026-02-18T03:50:26.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.788050] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000171 seconds 2026-02-18T03:50:26.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.804078] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000197 seconds 2026-02-18T03:50:26.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.820058] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000177 seconds 2026-02-18T03:50:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2813636239' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/703305425' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:26.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:26 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/107596028' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2813636239' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/703305425' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:26.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:26 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/107596028' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:27 trial086 ceph-mon[98535]: pgmap v829: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 7.3 MiB/s rd, 6.4 MiB/s wr, 721 op/s 2026-02-18T03:50:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:27 trial155 ceph-mon[104170]: pgmap v829: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 7.3 MiB/s rd, 6.4 MiB/s wr, 721 op/s 2026-02-18T03:50:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:29 trial086 ceph-mon[98535]: pgmap v830: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 228 op/s 2026-02-18T03:50:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:29 trial155 ceph-mon[104170]: pgmap v830: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 228 op/s 2026-02-18T03:50:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:31 trial086 ceph-mon[98535]: pgmap v831: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 989 KiB/s wr, 182 op/s 2026-02-18T03:50:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:31 trial155 ceph-mon[104170]: pgmap v831: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.5 MiB/s rd, 989 KiB/s wr, 182 op/s 2026-02-18T03:50:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:33 trial086 ceph-mon[98535]: pgmap v832: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 124 KiB/s rd, 0 B/s wr, 67 op/s 2026-02-18T03:50:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2375368812' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1150434939' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1188465911' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:33 trial155 ceph-mon[104170]: pgmap v832: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 124 KiB/s rd, 0 B/s wr, 67 op/s 2026-02-18T03:50:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2375368812' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1150434939' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1188465911' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:35 trial086 ceph-mon[98535]: pgmap v833: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 77 KiB/s rd, 0 B/s wr, 45 op/s 2026-02-18T03:50:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:35 trial155 ceph-mon[104170]: pgmap v833: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 77 KiB/s rd, 0 B/s wr, 45 op/s 2026-02-18T03:50:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:37 trial086 ceph-mon[98535]: pgmap v834: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 87 KiB/s rd, 0 B/s wr, 15 op/s 2026-02-18T03:50:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:37 trial155 ceph-mon[104170]: pgmap v834: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 87 KiB/s rd, 0 B/s wr, 15 op/s 2026-02-18T03:50:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:39 trial086 ceph-mon[98535]: pgmap v835: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:39 trial155 ceph-mon[104170]: pgmap v835: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3561570964' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/142739992' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:40.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:40 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1152540811' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3561570964' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/142739992' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:40.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:40 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1152540811' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:41 trial086 ceph-mon[98535]: pgmap v836: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:41 trial155 ceph-mon[104170]: pgmap v836: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:43 trial086 ceph-mon[98535]: pgmap v837: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:43 trial155 ceph-mon[104170]: pgmap v837: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:45 trial086 ceph-mon[98535]: pgmap v838: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:45 trial155 ceph-mon[104170]: pgmap v838: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:47 trial086 ceph-mon[98535]: pgmap v839: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1074222345' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/922612227' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:47.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/940702834' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:47 trial155 ceph-mon[104170]: pgmap v839: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1074222345' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/922612227' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/940702834' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:49 trial086 ceph-mon[98535]: pgmap v840: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:49 trial155 ceph-mon[104170]: pgmap v840: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:51 trial086 ceph-mon[98535]: pgmap v841: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:51 trial155 ceph-mon[104170]: pgmap v841: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:53 trial086 ceph-mon[98535]: pgmap v842: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:53 trial155 ceph-mon[104170]: pgmap v842: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2818068401' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3163151182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3588982632' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2818068401' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3163151182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:54.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3588982632' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:50:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:55 trial086 ceph-mon[98535]: pgmap v843: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:55.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:55 trial155 ceph-mon[104170]: pgmap v843: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:57 trial086 ceph-mon[98535]: pgmap v844: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:57 trial155 ceph-mon[104170]: pgmap v844: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:50:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:50:59 trial086 ceph-mon[98535]: pgmap v845: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:50:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:50:59 trial155 ceph-mon[104170]: pgmap v845: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:01 trial086 ceph-mon[98535]: pgmap v846: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/951303205' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1159877919' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4254884422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:01 trial155 ceph-mon[104170]: pgmap v846: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/951303205' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1159877919' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:01.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4254884422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:03 trial086 ceph-mon[98535]: pgmap v847: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:03 trial155 ceph-mon[104170]: pgmap v847: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:05 trial086 ceph-mon[98535]: pgmap v848: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:05 trial155 ceph-mon[104170]: pgmap v848: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:07 trial086 ceph-mon[98535]: pgmap v849: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:07 trial155 ceph-mon[104170]: pgmap v849: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/278318642' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2032035599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/983203965' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:08 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/278318642' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:08 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2032035599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:08.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:08 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/983203965' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:09 trial086 ceph-mon[98535]: pgmap v850: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:09 trial155 ceph-mon[104170]: pgmap v850: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:11 trial086 ceph-mon[98535]: pgmap v851: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:11.412 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #8: thrashed- nvmeof.c (by ceph_daemon_stop); 2026-02-18T03:51:11.412 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:51:11.412 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:51:11.441 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:48:41 UTC; 2min 30s ago 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114053 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114054 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 114131 (conmon) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 344.6M (peak: 347.0M) 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 9min 54.420s 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114133 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114135 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114251 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114525 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: │ └─114542 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: └─114131 /usr/bin/conmon --api-version 1 -c 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -u 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata -p /run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.672092] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000210 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.692098] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_30 elapsed time: 0.000220 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.708064] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000188 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.724041] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_14 elapsed time: 0.000166 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.740057] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000180 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.756070] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000192 seconds 2026-02-18T03:51:11.442 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.772076] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000199 seconds 2026-02-18T03:51:11.443 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.788050] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_1 elapsed time: 0.000171 seconds 2026-02-18T03:51:11.443 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.804078] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000197 seconds 2026-02-18T03:51:11.443 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:50:25 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [2026-02-18 03:50:25.820058] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000177 seconds 2026-02-18T03:51:11.443 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 11min ago 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 357.8M (peak: 361.0M) 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 44min 59.492s 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:51:11.472 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:51:11.473 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49280 2026-02-18T03:51:11.474 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:51:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:11 trial155 ceph-mon[104170]: pgmap v851: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:11.506 INFO:teuthology.orchestra.run.trial155.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Active: inactive (dead) since Wed 2026-02-18 03:50:20 UTC; 50s ago 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Duration: 5min 58.877s 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91482 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Process: 91483 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105026 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105103 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105140 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 91554 (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.507 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 23min 50.174s 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[91554]: [18-Feb-2026 03:50:20] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 podman[105060]: 2026-02-18 03:50:20.513420268 +0000 UTC m=+1.813700370 container died 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-type=git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.buildah.version=1.29.0, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, url=https://github.com/ceph/ceph-nvmeof, release=, vendor=Red Hat, Inc., io.openshift.wants=ceph,rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.ceph-release=20.2.0, summary=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.version=1.6.5, io.ceph.nvmeof=, io.spdk.git.branch=undefined, distribution-scope=public, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, version=1.6.5, build-date=2026-02-11 09:53:49 UTC, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.ceph.maintainer=Ceph Developers , maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway) 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 podman[105060]: 2026-02-18 03:50:20.52503655 +0000 UTC m=+1.825316642 container remove 6656e6ed9326d984f6b4c880097a74210345eb8f7c295de7b1279c10b3fcbc9a (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, maintainer=Ceph Developers , io.ceph.nvmeof=, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., org.centos.version=9.0-30.el9, io.spdk.build.makeflags=, release=, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.spdk.git.branch=undefined, io.ceph.git.branch=devel, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.target-arch=x86-64-v2, summary=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, com.redhat.component=ubi9-container, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.summary=Ceph NVMe over Fabrics Gateway, vendor=Red Hat, Inc., io.openshift.wants=ceph,rbd, io.ceph.url=https://github.com/ceph/ceph-nvmeof, distribution-scope=public, vcs-type=git, io.spdk.version=25.09, io.ceph.maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0) 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 bash[105060]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Deactivated successfully. 2026-02-18T03:51:11.508 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:51:11.509 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:50:20 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 23min 50.174s CPU time, 352.8M memory peak. 2026-02-18T03:51:11.509 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:51:11.510 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 8min ago 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 375.5M (peak: 378.5M) 2026-02-18T03:51:11.540 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 34min 48.152s 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:51:11.541 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:51:11.542 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:51:11.544 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:51:11.763 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:51:11.763 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 2m ago 26m trial034=x;count:1 2026-02-18T03:51:11.763 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 2m ago 26m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:51:11.763 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 3/4 8m ago 24m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:51:11.763 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 2m ago 25m trial155 2026-02-18T03:51:11.770 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:51:11.950 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:51:11.950 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (2m) 2m ago 15m 56.6M - 1.6.5 99a57256b38c 0a2f92368348 2026-02-18T03:51:11.950 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (11m) 67s ago 15m 371M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:51:11.950 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 stopped 50s ago 6m - - 2026-02-18T03:51:11.950 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (8m) 8m ago 15m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:51:11.957 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:51:12.176 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:12.176 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:12.176 INFO:teuthology.orchestra.run.trial177.stdout: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:12.183 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:51:12.398 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:51:12.398 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:12.398 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: 1/3 mons down, quorum c,b 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum c,b (age 53s) [leader: c], out of quorum: a 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 26m) 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 24m), 8 in (since 25m) 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 3 gateways active (3 hosts) 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: usage: 56 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: client: 84 KiB/s rd, 0 B/s wr, 5 op/s rd, 2 op/s wr 2026-02-18T03:51:12.399 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:51:12.406 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 231, 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 4, 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 173, 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:51:12.636 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "CREATED", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:51:12.637 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:51:12.638 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:51:12.644 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:51:12.705 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:51:12.705 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:51:12.705 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.706 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:51:12.707 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.708 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.709 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.710 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.711 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:51:12.712 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:51:12.757 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:12.758 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:51:12.804 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:12.805 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:51:12.849 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:12.850 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:51:12.893 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:12.895 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:51:12.979 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:12.980 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:51:13.026 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.027 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:51:13.072 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.072 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:51:13.117 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.118 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:51:13.187 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.188 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:51:13.273 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.274 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:51:13.316 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.317 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: from='client.111761 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: from='client.111767 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: pgmap v852: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/681441705' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4130512724' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:51:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2861707697' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:51:13.402 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.403 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:51:13.448 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.449 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: from='client.111761 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: from='client.111767 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: pgmap v852: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/681441705' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4130512724' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:51:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:13 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2861707697' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:51:13.491 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.492 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:51:13.579 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.580 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:51:13.625 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.626 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:51:13.670 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.671 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:51:13.755 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.757 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:51:13.801 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.801 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:51:13.885 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.887 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:51:13.931 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.932 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:51:13.978 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:13.978 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:51:14.022 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.024 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:51:14.068 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.069 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:51:14.154 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.156 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:51:14.200 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.201 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:51:14.247 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.248 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:51:14.293 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.293 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:51:14.377 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.379 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:51:14.463 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.465 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:51:14.510 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.511 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:51:14.556 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.556 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:51:14.601 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.602 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:51:14.646 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.647 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:51:14.691 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.693 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:51:14.736 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.738 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:51:14.782 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.783 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:51:14.868 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.868 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:51:14.914 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.914 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:51:14.959 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:14.961 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:51:15.004 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.006 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:51:15.050 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.050 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:51:15.137 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.137 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:51:15.180 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.182 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:51:15.265 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.267 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:51:15.313 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.314 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:51:15.359 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.360 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:51:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:15 trial086 ceph-mon[98535]: pgmap v853: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2582708171' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1170133259' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3721661857' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.446 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.447 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:51:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:15 trial155 ceph-mon[104170]: pgmap v853: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:15 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2582708171' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:15 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1170133259' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:15 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3721661857' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:15.491 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.492 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:51:15.538 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.539 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:51:15.584 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.585 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:51:15.669 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.670 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:51:15.759 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.759 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:51:15.804 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.805 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:51:15.849 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.849 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:51:15.938 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.938 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:51:15.982 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:15.984 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:51:16.028 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.030 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:51:16.074 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.075 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:51:16.119 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.120 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:51:16.163 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.164 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:51:16.251 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.252 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:51:16.296 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.297 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:51:16.381 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:51:16.383 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.c 2026-02-18T03:51:16.383 DEBUG:teuthology.orchestra.run.trial155:> ceph orch daemon restart nvmeof.nvmeof.c --force 2026-02-18T03:51:16.574 INFO:teuthology.orchestra.run.trial155.stdout:Scheduled to restart nvmeof.nvmeof.c on host 'trial155' 2026-02-18T03:51:16.583 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 60 secs before thrashing 2026-02-18T03:51:17.337 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 systemd[1]: Starting Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: pgmap v854: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:17.338 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:17.339 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.339 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: pgmap v854: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:17.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:17 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:17.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 podman[105818]: 2026-02-18 03:51:17.336381523 +0000 UTC m=+0.018443354 container create 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.ceph.component=ceph-nvmeof, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.ceph-release=20.2.0, summary=Ceph NVMe over Fabrics Gateway, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, architecture=x86_64, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.git.branch=devel, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-30.el9, url=https://github.com/ceph/ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.buildah.version=1.29.0, io.ceph.nvmeof=, maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, release=, vcs-type=git, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, name=ceph-nvmeof, io.spdk.build.makeflags=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage) 2026-02-18T03:51:17.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 podman[105818]: 2026-02-18 03:51:17.365429675 +0000 UTC m=+0.047491516 container init 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.maintainer=Ceph Developers , distribution-scope=public, io.openshift.wants=ceph,rbd, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.component=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.nvmeof=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, architecture=x86_64, com.redhat.component=ubi9-container, org.centos.version=9.0-30.el9, version=1.6.5, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2026-02-11 09:53:49 UTC, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, release=, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, maintainer=Ceph Developers , io.spdk.build.target-arch=x86-64-v2, url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, io.spdk.build.ceph-release=20.2.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., vcs-type=git, io.ceph.git.branch=devel) 2026-02-18T03:51:17.598 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 podman[105818]: 2026-02-18 03:51:17.367691011 +0000 UTC m=+0.049752852 container start 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-type=git, io.buildah.version=1.29.0, io.spdk.build.target-arch=x86-64-v2, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.wants=ceph,rbd, name=ceph-nvmeof, version=1.6.5, io.ceph.component=ceph-nvmeof, io.ceph.nvmeof=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, com.redhat.component=ubi9-container, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.branch=devel, vendor=Red Hat, Inc., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, maintainer=Ceph Developers , architecture=x86_64, io.spdk.git.branch=undefined, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, release=, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.version=25.09) 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 bash[105818]: 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 podman[105818]: 2026-02-18 03:51:17.328183505 +0000 UTC m=+0.010245336 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 systemd[1]: Started Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c, using rotation 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:51:17.599 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [gateway] 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): name = client.nvmeof.nvmeof.c 2026-02-18T03:51:17.600 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): port = 5500 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:51:17.601 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:51:17.602 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:51:17.603 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): force_tls = False 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:51:17.604 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [discovery] 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): addr = 10.20.193.155 2026-02-18T03:51:17.605 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): port = 8009 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [ceph] 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): pool = mypool 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): id = nvmeof.nvmeof.c 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [mtls] 2026-02-18T03:51:17.606 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [spdk] 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): transports = tcp 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:51:17.608 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): [monitor] 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.c 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:51:17.609 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:51:17.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:51:17.610 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:17 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:17] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.155:5499 for group id 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='client.136675 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='client.136675 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.c group id=2 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:51:18.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:51:18.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:51:18.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:18 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:18] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:51:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:19 trial086 ceph-mon[98535]: pgmap v855: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:19 trial155 ceph-mon[104170]: pgmap v855: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:20.210 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:51:20.211 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:51:20.211 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:reviving mon.a 2026-02-18T03:51:20.211 INFO:tasks.cephadm.mon.a:Restarting mon.a (starting--it wasn't running)... 2026-02-18T03:51:20.211 DEBUG:teuthology.orchestra.run.trial034:mon.a> sudo journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service 2026-02-18T03:51:20.214 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl start ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:51:20.425 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:51:20.425 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 systemd[1]: Starting Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 podman[125794]: 2026-02-18 03:51:20.379448485 +0000 UTC m=+0.015813067 container create f8f27d6021ebc6b4ca0687d6119747e4ba376371de17d99b6e5a81a1fbcc4ab1 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 podman[125794]: 2026-02-18 03:51:20.415663899 +0000 UTC m=+0.052028481 container init f8f27d6021ebc6b4ca0687d6119747e4ba376371de17d99b6e5a81a1fbcc4ab1 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 podman[125794]: 2026-02-18 03:51:20.41788341 +0000 UTC m=+0.054247982 container start f8f27d6021ebc6b4ca0687d6119747e4ba376371de17d99b6e5a81a1fbcc4ab1 (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7) 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 bash[125794]: f8f27d6021ebc6b4ca0687d6119747e4ba376371de17d99b6e5a81a1fbcc4ab1 2026-02-18T03:51:20.523 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 podman[125794]: 2026-02-18 03:51:20.37333751 +0000 UTC m=+0.009702092 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 systemd[1]: Started Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: set uid:gid to 167:167 (ceph:ceph) 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: pidfile_write: ignore empty --pid-file 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: load: jerasure load: lrc 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: RocksDB version: 7.9.2 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Git sha 0 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Compile date 2026-02-17 18:17:02 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: DB SUMMARY 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: DB Session ID: 2XEROG1H3FGA2RT09RAP 2026-02-18T03:51:20.524 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: CURRENT file: CURRENT 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: IDENTITY file: IDENTITY 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: MANIFEST file: MANIFEST-000046 size: 1537 Bytes 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000063.sst 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000061.log size: 940682 ; 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.error_if_exists: 0 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.create_if_missing: 0 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.paranoid_checks: 1 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.env: 0x556a7ba7e100 2026-02-18T03:51:20.525 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.fs: PosixFileSystem 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.info_log: 0x556a82078e80 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_file_opening_threads: 16 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.statistics: (nil) 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.use_fsync: 0 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_log_file_size: 0 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.keep_log_file_num: 1000 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.recycle_log_file_num: 0 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_fallocate: 1 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_mmap_reads: 0 2026-02-18T03:51:20.526 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_mmap_writes: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.use_direct_reads: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.create_missing_column_families: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.db_log_dir: 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.wal_dir: 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-18T03:51:20.527 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.advise_random_on_open: 1 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.db_write_buffer_size: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.write_buffer_manager: 0x556a8207cb40 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.rate_limiter: (nil) 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.wal_recovery_mode: 2 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enable_thread_tracking: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enable_pipelined_write: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.unordered_write: 0 2026-02-18T03:51:20.528 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.row_cache: None 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.wal_filter: None 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_ingest_behind: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.two_write_queues: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.manual_wal_flush: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.wal_compression: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.atomic_flush: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-18T03:51:20.529 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.log_readahead_size: 0 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.best_efforts_recovery: 0 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.allow_data_in_errors: 0 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.db_host_id: __hostname__ 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_background_jobs: 2 2026-02-18T03:51:20.530 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_background_compactions: -1 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_subcompactions: 1 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_total_wal_size: 0 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-18T03:51:20.531 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_open_files: -1 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bytes_per_sync: 0 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-18T03:51:20.532 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_readahead_size: 0 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_background_flushes: -1 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Compression algorithms supported: 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kZSTD supported: 0 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kXpressCompression supported: 0 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kBZip2Compression supported: 0 2026-02-18T03:51:20.533 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kLZ4Compression supported: 1 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kZlibCompression supported: 1 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kLZ4HCCompression supported: 1 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: kSnappyCompression supported: 1 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-18T03:51:20.534 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000046 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.merge_operator: 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_filter: None 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_filter_factory: None 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.sst_partitioner_factory: None 2026-02-18T03:51:20.535 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556a820783c0) 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks: 1 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-18T03:51:20.536 INFO:journalctl@ceph.mon.a.trial034.stdout: pin_top_level_index_and_filter: 1 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: index_type: 0 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_index_type: 0 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: index_shortening: 1 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: checksum: 4 2026-02-18T03:51:20.537 INFO:journalctl@ceph.mon.a.trial034.stdout: no_block_cache: 0 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache: 0x556a82099b90 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_name: BinnedLRUCache 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_options: 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: capacity : 536870912 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: num_shard_bits : 4 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: strict_capacity_limit : 0 2026-02-18T03:51:20.538 INFO:journalctl@ceph.mon.a.trial034.stdout: high_pri_pool_ratio: 0.000 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: block_cache_compressed: (nil) 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: persistent_cache: (nil) 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size: 4096 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: block_size_deviation: 10 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: block_restart_interval: 16 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: index_block_restart_interval: 1 2026-02-18T03:51:20.539 INFO:journalctl@ceph.mon.a.trial034.stdout: metadata_block_size: 4096 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: partition_filters: 0 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: use_delta_encoding: 1 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: filter_policy: bloomfilter 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: whole_key_filtering: 1 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: verify_compression: 0 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: read_amp_bytes_per_bit: 0 2026-02-18T03:51:20.540 INFO:journalctl@ceph.mon.a.trial034.stdout: format_version: 5 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_index_compression: 1 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: block_align: 0 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: max_auto_readahead_size: 262144 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: prepopulate_block_cache: 0 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: initial_auto_readahead_size: 8192 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout: num_file_reads_for_auto_readahead: 2 2026-02-18T03:51:20.541 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.write_buffer_size: 33554432 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_write_buffer_number: 2 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression: NoCompression 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression: Disabled 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.prefix_extractor: nullptr 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.num_levels: 7 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-18T03:51:20.542 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-18T03:51:20.543 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.level: 32767 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.strategy: 0 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-18T03:51:20.544 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.enabled: false 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-18T03:51:20.545 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.target_file_size_base: 67108864 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-18T03:51:20.546 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.arena_block_size: 1048576 2026-02-18T03:51:20.547 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.disable_auto_compactions: 0 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-18T03:51:20.548 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.inplace_update_support: 0 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-18T03:51:20.549 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.bloom_locality: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.max_successive_merges: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.paranoid_file_checks: 0 2026-02-18T03:51:20.550 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.force_consistency_checks: 1 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.report_bg_io_stats: 0 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.ttl: 2592000 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enable_blob_files: false 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.min_blob_size: 0 2026-02-18T03:51:20.551 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_file_size: 268435456 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.blob_file_starting_level: 0 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-18T03:51:20.552 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000046 succeeded,manifest_file_number is 46, next_file_number is 65, last_sequence is 26267, log_number is 61,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 61 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 61 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8df5c88d-f7b2-4851-aabb-a44400590142 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386680446532, "job": 1, "event": "recovery_started", "wal_files": [61]} 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #61 mode 2 2026-02-18T03:51:20.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386680449571, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 66, "file_size": 926363, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 26268, "largest_seqno": 27002, "table_properties": {"data_size": 922149, "index_size": 2407, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 6498, "raw_average_key_size": 21, "raw_value_size": 915428, "raw_average_value_size": 3051, "num_data_blocks": 108, "num_entries": 300, "num_filter_entries": 300, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771386680, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8df5c88d-f7b2-4851-aabb-a44400590142", "db_session_id": "2XEROG1H3FGA2RT09RAP", "orig_file_number": 66, "seqno_to_time_mapping": "N/A"}} 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771386680449678, "job": 1, "event": "recovery_finished"} 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:5047] Creating manifest 68 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000061.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556a8209c700 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: DB pointer 0x556a820ae000 2026-02-18T03:51:20.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: ** DB Stats ** 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:51:20.555 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-18T03:51:20.556 INFO:journalctl@ceph.mon.a.trial034.stdout: L0 1/0 904.65 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 462.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: L6 1/0 9.59 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: Sum 2/0 10.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 462.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 462.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: ** Compaction Stats [default] ** 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-18T03:51:20.557 INFO:journalctl@ceph.mon.a.trial034.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 462.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: Flush(GB): cumulative 0.001, interval 0.001 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-18T03:51:20.558 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: Cumulative compaction: 0.00 GB write, 162.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: Interval compaction: 0.00 GB write, 162.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache BinnedLRUCache@0x556a82099b90#2 capacity: 512.00 MB usage: 3.49 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000174344%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2026-02-18T03:51:20.559 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: starting mon.a rank 0 at public addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] at bind addrs [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???) e3 preinit fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).mds e1 new map 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).mds e1 print_map 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout: e1 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout: btime 2026-02-18T03:24:09:561635+0000 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T03:51:20.560 INFO:journalctl@ceph.mon.a.trial034.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout: legacy client fscid: -1 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout: 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout: No filesystems configured 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).osd e60 crush map has features 3314933000852226048, adjusting msgr requires 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).osd e60 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).osd e60 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).osd e60 crush map has features 288514051259236352, adjusting msgr requires 2026-02-18T03:51:20.561 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:20 trial034 ceph-mon[125822]: mon.a@-1(???).paxosservice(auth 1..52) refresh upgraded, format 0 -> 3 2026-02-18T03:51:20.656 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":58,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":62,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:656 (2): SPDK process id: 76 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: INFO: Setting log level to WARNING 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.634447] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.634498] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76 ] 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.750919] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.776621] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.776631] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.776639] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.776641] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:51:20.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.891967] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:51:21.145 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-mon[104170]: pgmap v856: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:21.145 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3886395683' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:21.145 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/19481030' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:51:21.146 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4193688388' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:473 (2): Discovery service process id: 81 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:461 (81): Starting ceph nvmeof discovery service 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO state.py:894 (81): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO discovery.py:344 (81): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:51:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO discovery.py:369 (81): discovery addr: 10.20.193.155 port: 8009 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.939250] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:20.939283] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO state.py:1684 (81): Start update from 1 to 161 (discovery-trial155). 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO state.py:2068 (81): Update complete (1 -> 161) (discovery-trial155). 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO state.py:2073 (81): Initialization is over (discovery-trial155). 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO cephutils.py:308 (2): Registered nvmeof.c to service_map! 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:51:21.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:20] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:51:21.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:51:21.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:21 trial086 ceph-mon[98535]: pgmap v856: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3886395683' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/19481030' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:51:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4193688388' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:21.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:51:21.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.257694] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.155:0/1953683959, rc 0 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.257789] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.155:0/1953683959 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.155:0/1953683959' 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.270461] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.275182] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.275376] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.275396] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.378999] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.155:0/4035785962, rc 0 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.379058] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.155:0/4035785962 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.155:0/4035785962' 2026-02-18T03:51:21.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.392028] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:51:21.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.398197] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:51:21.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.398219] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:21.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.504819] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.155:0/1731600077, rc 0 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.504905] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.155:0/1731600077 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.155:0/1731600077' 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.517579] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:51:21.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.522134] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.522158] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.621617] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.155:0/3418414900, rc 0 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.621676] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.155:0/3418414900 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.155:0/3418414900' 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.634312] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.638876] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.638896] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:21.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.742308] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.155:0/832968595, rc 0 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.742361] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.155:0/832968595 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.155:0/832968595' 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.755044] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.759512] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.759532] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.854938] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.155:0/2859778497, rc 0 2026-02-18T03:51:21.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.854996] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.155:0/2859778497 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.155:0/2859778497' 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.868324] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.873483] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.873503] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.969024] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.155:0/268030890, rc 0 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.969078] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.155:0/268030890 2026-02-18T03:51:21.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.155:0/268030890' 2026-02-18T03:51:22.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/241282949' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/139870546' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.229 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2557034795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.982233] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:21] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.987236] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:21 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:21.987256] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.086832] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.155:0/383594788, rc 0 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.086895] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.155:0/383594788 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.155:0/383594788' 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.099506] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.104008] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.104029] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.199788] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.155:0/3554880993, rc 0 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.199846] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.155:0/3554880993 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.155:0/3554880993' 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.212609] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.217145] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:51:22.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.217168] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:22 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/241282949' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:22 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/139870546' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:22 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2557034795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:22.558 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.558 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.558 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.312839] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.155:0/131985440, rc 0 2026-02-18T03:51:22.558 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.312907] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.155:0/131985440 2026-02-18T03:51:22.558 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.155:0/131985440' 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.328539] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.333081] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.333103] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.436963] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.155:0/2920498583, rc 0 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.438025] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.155:0/2920498583 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.155:0/2920498583' 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.451949] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.559 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.457191] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.457214] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.556698] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.155:0/464777684, rc 0 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.556761] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.155:0/464777684 2026-02-18T03:51:22.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.155:0/464777684' 2026-02-18T03:51:22.870 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.568580] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.573421] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.573442] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.677665] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.155:0/896141423, rc 0 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.677750] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.155:0/896141423 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.155:0/896141423' 2026-02-18T03:51:22.871 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.688437] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.692934] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.692956] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.784667] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.155:0/1813215696, rc 0 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.784734] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.155:0/1813215696 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.155:0/1813215696' 2026-02-18T03:51:22.872 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.797995] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:22.873 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:51:22.873 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.802695] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:51:22.873 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.802718] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:22.873 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:22.873 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.136 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-mon[104170]: pgmap v857: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 93 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:51:23.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.902537] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.155:0/2175494550, rc 0 2026-02-18T03:51:23.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.902618] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.155:0/2175494550 2026-02-18T03:51:23.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.155:0/2175494550' 2026-02-18T03:51:23.137 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.916639] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.921173] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:22.921197] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:22 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:22] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.020918] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.155:0/2673203262, rc 0 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.020996] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.155:0/2673203262 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.155:0/2673203262' 2026-02-18T03:51:23.138 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.034538] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.039580] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.039605] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.139 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.135564] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.155:0/3915639671, rc 0 2026-02-18T03:51:23.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:23 trial086 ceph-mon[98535]: pgmap v857: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 93 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:51:23.388 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.136033] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.155:0/3915639671 2026-02-18T03:51:23.388 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.155:0/3915639671' 2026-02-18T03:51:23.388 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.149734] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.154487] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.154509] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.254304] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.155:0/68211807, rc 0 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.254366] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.155:0/68211807 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.155:0/68211807' 2026-02-18T03:51:23.389 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.266136] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.270625] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.270648] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.374461] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.155:0/3102971326, rc 0 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.375024] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.155:0/3102971326 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.155:0/3102971326' 2026-02-18T03:51:23.390 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.387010] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:23.666 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:51:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:51:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.391679] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:51:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:23.391700] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:23.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:23 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:23] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:23.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v840: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v841: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v842: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2818068401' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3163151182' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3588982632' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v843: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v844: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v845: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v846: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/951303205' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1159877919' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/4254884422' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v847: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v848: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v849: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/278318642' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2032035599' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/983203965' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v850: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v851: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.111761 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.111767 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v852: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/681441705' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/4130512724' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:51:23.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2861707697' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v853: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2582708171' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1170133259' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3721661857' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v854: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:23.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:23.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:23.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.136675 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.c", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: Schedule restart daemon nvmeof.nvmeof.c 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:51:23.777 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v855: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v856: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3886395683' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/19481030' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/4193688388' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/241282949' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.778 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/139870546' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2557034795' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:23.779 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:23 trial034 ceph-mon[125822]: pgmap v857: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 93 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: pgmap v858: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 176 KiB/s rd, 853 B/s wr, 126 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: pgmap v859: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 304 KiB/s rd, 1.5 KiB/s wr, 230 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: pgmap v860: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: pgmap v861: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: pgmap v862: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 318 KiB/s rd, 1.6 KiB/s wr, 241 op/s 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:33.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:33.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:33 trial086 ceph-mon[98535]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: mon.b calling monitor election 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: mon.c calling monitor election 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: pgmap v858: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 176 KiB/s rd, 853 B/s wr, 126 op/s 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: pgmap v859: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 304 KiB/s rd, 1.5 KiB/s wr, 230 op/s 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: pgmap v860: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: pgmap v861: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: pgmap v862: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 318 KiB/s rd, 1.6 KiB/s wr, 241 op/s 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: monmap epoch 3 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: min_mon_release 20 (tentacle) 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: election_strategy: 1 2026-02-18T03:51:33.897 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: fsmap 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:33.898 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-mon[104170]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:33.896084] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.155:0/1983092078, rc 0 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:33.896176] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.155:0/1983092078 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.155:0/1983092078' 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:33.912374] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:33] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:33.916925] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:33.916948] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:33] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.012750] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.155:0/46196159, rc 0 2026-02-18T03:51:34.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.013027] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.155:0/46196159 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.155:0/46196159' 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.025768] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.030715] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.030737] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.126392] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.155:0/2773103954, rc 0 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.127020] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.155:0/2773103954 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.155:0/2773103954' 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.141486] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:51:34.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.146322] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:51:34.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.146347] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:34.302 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":64,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:51:34.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.249921] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.155:0/3681157474, rc 0 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.250008] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.155:0/3681157474 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.155:0/3681157474' 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.262726] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.267271] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.267292] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.389136] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.155:0/1279322259, rc 0 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.389221] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.155:0/1279322259 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.155:0/1279322259' 2026-02-18T03:51:34.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.401182] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.720 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-mon[104170]: pgmap v863: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 280 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:34.720 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/976276409' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:34.720 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/227601105' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.405698] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.405718] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.505358] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.155:0/1283479395, rc 0 2026-02-18T03:51:34.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.505421] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.155:0/1283479395 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.155:0/1283479395' 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.518420] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.522925] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.522947] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.626672] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.155:0/3990829915, rc 0 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.626744] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.155:0/3990829915 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.155:0/3990829915' 2026-02-18T03:51:34.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.639498] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:51:34.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.643941] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:51:34.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.643963] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:34.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:51:34] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:51:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: ], , client address: IPv4 10.20.193.34:34530 2026-02-18T03:51:34.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:34 trial086 ceph-mon[98535]: pgmap v863: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 280 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:34.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/976276409' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:34.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/227601105' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.751939] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.155:0/718745022, rc 0 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.752011] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.155:0/718745022 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.155:0/718745022' 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.765071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.769633] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.769657] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.869839] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.155:0/1079785372, rc 0 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.870018] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.155:0/1079785372 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.155:0/1079785372' 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.881473] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.885967] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.885988] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:34.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.985618] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.155:0/113140798, rc 0 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.985677] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.155:0/113140798 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.155:0/113140798' 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:34.997215] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:34] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.001733] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.001752] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.101145] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.155:0/2172992539, rc 0 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.101203] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.155:0/2172992539 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.155:0/2172992539' 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.113407] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.117940] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.117962] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.213775] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.155:0/1777901893, rc 0 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.213838] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.155:0/1777901893 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.155:0/1777901893' 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.228870] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.233276] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.233299] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.301 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4032968115' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:35.573 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4158008190' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.328996] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.155:0/3059161709, rc 0 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.329056] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.155:0/3059161709 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.155:0/3059161709' 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.342703] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.347164] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.347185] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.446847] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.451352] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.451374] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.539019] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.572252] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:51:35.573 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.572280] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.680016] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.684472] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.684493] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.780786] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.785234] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.785258] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:35.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:35 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4032968115' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:35.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:35 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4158008190' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:36.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.888876] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:51:36.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.895287] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:51:36.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.895309] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:36.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.992009] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:35] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.997398] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:35.997425] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.097567] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.101956] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.101980] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:36.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.425 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.206138] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.210563] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.210589] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.310215] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.314625] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:51:36.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.314653] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.418032] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.424229] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:51:36.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.424249] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:36.719 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-mon[104170]: pgmap v864: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 258 KiB/s rd, 1.2 KiB/s wr, 187 op/s 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.527097] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.531820] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:51:36.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.531847] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.644558] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.649013] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.649035] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:36 trial086 ceph-mon[98535]: pgmap v864: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 258 KiB/s rd, 1.2 KiB/s wr, 187 op/s 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.752903] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.757488] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.757511] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.860839] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:36.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:51:36.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.865335] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:51:36.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.865364] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:36.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:36.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:36.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.973761] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:36] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.978504] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:36.978529] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.083636] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.088093] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.088125] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.192034] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.209272] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:51:37.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.209298] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:37.314 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.318363] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.322947] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.322967] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:37.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.439947] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.444377] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.444399] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.547521] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:51:37.551 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":64,"quorum":[1,2],"quorum_names":["c","b"],"quorum_leader_name":"c","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.551963] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.551987] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.660578] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:51:37.847 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.665011] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.665032] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.772507] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.776870] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.776892] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:37.848 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.880728] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.885145] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.885167] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.992116] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:37] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.996514] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:37.996536] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.107 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.108 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.105272] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:51:38.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.109894] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:51:38.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.109915] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:38.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.213807] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.218282] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.218305] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.325420] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.329884] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.329905] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:38.400 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.401 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.434850] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:51:38.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.439255] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:51:38.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.439276] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:38.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.711 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a calling monitor election 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a calling monitor election 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a calling monitor election 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.b calling monitor election 2026-02-18T03:51:38.712 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.c calling monitor election 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a calling monitor election 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: monmap epoch 3 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: min_mon_release 20 (tentacle) 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: election_strategy: 1 2026-02-18T03:51:38.713 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: fsmap 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: Cluster is now healthy 2026-02-18T03:51:38.714 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-mon[104170]: overall HEALTH_OK 2026-02-18T03:51:38.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.b calling monitor election 2026-02-18T03:51:38.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.c calling monitor election 2026-02-18T03:51:38.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v858: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 176 KiB/s rd, 853 B/s wr, 126 op/s 2026-02-18T03:51:38.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v859: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 304 KiB/s rd, 1.5 KiB/s wr, 230 op/s 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v860: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v861: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 285 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v862: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 318 KiB/s rd, 1.6 KiB/s wr, 241 op/s 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.c is new leader, mons c,b in quorum (ranks 1,2) 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: monmap epoch 3 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: min_mon_release 20 (tentacle) 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: election_strategy: 1 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:38.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: fsmap 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v863: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 280 KiB/s rd, 1.6 KiB/s wr, 237 op/s 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/976276409' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/227601105' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/4032968115' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:38.773 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/4158008190' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: pgmap v864: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 258 KiB/s rd, 1.2 KiB/s wr, 187 op/s 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.b calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.c calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a calling monitor election 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:51:38.774 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: monmap epoch 3 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: min_mon_release 20 (tentacle) 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: election_strategy: 1 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: fsmap 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:38.775 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:51:38.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: Cluster is now healthy 2026-02-18T03:51:38.776 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:38 trial034 ceph-mon[125822]: overall HEALTH_OK 2026-02-18T03:51:38.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:51:38.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a is new leader, mons a,b in quorum (ranks 0,2) 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: Health detail: HEALTH_WARN 1/3 mons down, quorum c,b 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: [WRN] MON_DOWN: 1/3 mons down, quorum c,b 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a (rank 0) addr [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] is down (out of quorum) 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.b calling monitor election 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.c calling monitor election 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a calling monitor election 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-18T03:51:38.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: monmap epoch 3 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: last_changed 2026-02-18T03:24:53.237470+0000 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: created 2026-02-18T03:24:08.615934+0000 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: min_mon_release 20 (tentacle) 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: election_strategy: 1 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: 0: [v2:10.20.193.34:3300/0,v1:10.20.193.34:6789/0] mon.a 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: 1: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.c 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: 2: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: fsmap 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: osdmap e60: 8 total, 8 up, 8 in 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: mgrmap e15: x(active, since 27m) 2026-02-18T03:51:38.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum c,b) 2026-02-18T03:51:38.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:51:38.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:38 trial086 ceph-mon[98535]: overall HEALTH_OK 2026-02-18T03:51:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.744832] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:51:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.749282] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:51:38.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.749303] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.853614] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.858072] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.858093] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.958085] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:38] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.962503] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:51:38.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:38.962526] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:39.061674] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:39.066160] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:39.066182] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:39.138039] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.155 port 4420 *** 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.483 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial086 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial034 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial155 differs from requested host trial177 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:51:39.485 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:39] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.c). 2026-02-18T03:51:39.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4006459442' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:39.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:39 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4006459442' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:40.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:39 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/4006459442' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:40.560 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:51:40.795 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:51:40.803 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:40 trial034 ceph-mon[125822]: pgmap v866: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 423 KiB/s rd, 2.8 KiB/s wr, 410 op/s 2026-02-18T03:51:40.804 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:51:40.804 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon a 2026-02-18T03:51:40.804 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-18T03:51:40.835 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:40 trial155 ceph-mon[104170]: pgmap v866: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 423 KiB/s rd, 2.8 KiB/s wr, 410 op/s 2026-02-18T03:51:40.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:40 trial086 ceph-mon[98535]: pgmap v866: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 423 KiB/s rd, 2.8 KiB/s wr, 410 op/s 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "state": "leader", 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 68, 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 20423, 2026-02-18T03:51:40.876 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.877 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:51:40.878 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.879 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.880 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:51:40.881 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.882 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:51:40.883 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:51:40.883 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:51:40.883 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon b 2026-02-18T03:51:40.884 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 68, 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 709019, 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:51:40.960 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.961 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.962 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:51:40.963 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.964 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:51:40.965 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:51:40.966 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:40.967 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.968 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.969 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.970 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.971 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.972 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.973 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:51:40.974 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: "osd": [ 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: "num": 8 2026-02-18T03:51:40.975 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: "num": 100 2026-02-18T03:51:40.976 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: "num": 2 2026-02-18T03:51:40.977 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:40.978 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:40.978 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:40.978 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:51:40.978 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:51:40.981 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:51:40.981 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for quorum size 3 for mon c 2026-02-18T03:51:40.981 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-18T03:51:41.061 INFO:teuthology.orchestra.run.trial034.stdout:{ 2026-02-18T03:51:41.061 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:51:41.061 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:51:41.061 INFO:teuthology.orchestra.run.trial034.stdout: "state": "peon", 2026-02-18T03:51:41.061 INFO:teuthology.orchestra.run.trial034.stdout: "election_epoch": 68, 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "uptime": 180492, 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "quorum": [ 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: 0, 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: 1, 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: 2 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_age": 2, 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "required_con": "2453899407728394244", 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "required_mon": [ 2026-02-18T03:51:41.062 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:41.063 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_con": "4544132024016699391", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "quorum_mon": [ 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:41.064 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "outside_quorum": [], 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "extra_probe_peers": [], 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "sync_provider": [], 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "monmap": { 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "epoch": 3, 2026-02-18T03:51:41.065 INFO:teuthology.orchestra.run.trial034.stdout: "fsid": "3ff67590-0c79-11f1-9051-d404e6e7d460", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "modified": "2026-02-18T03:24:53.237470Z", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "created": "2026-02-18T03:24:08.615934Z", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release": 20, 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "min_mon_release_name": "tentacle", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "election_strategy": 1, 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "disallowed_leaders": "", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false, 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "tiebreaker_mon": "", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "removed_ranks": "", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "features": { 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "persistent": [ 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "kraken", 2026-02-18T03:51:41.066 INFO:teuthology.orchestra.run.trial034.stdout: "luminous", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "mimic", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "osdmap-prune", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "nautilus", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "octopus", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "pacific", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "elector-pinging", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "quincy", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "reef", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "squid", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "tentacle", 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: "nvmeof_beacon_diff" 2026-02-18T03:51:41.067 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "optional": [] 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "mons": [ 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 0, 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "name": "a", 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:3300", 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.068 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789", 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.34:6789/0", 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.34:6789/0", 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:41.069 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 1, 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "name": "c", 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:3300", 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.070 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789", 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.155:6789/0", 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.155:6789/0", 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:41.071 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "rank": 2, 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "name": "b", 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "public_addrs": { 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "addrvec": [ 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v2", 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:3300", 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "type": "v1", 2026-02-18T03:51:41.072 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789", 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "nonce": 0 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "addr": "10.20.193.86:6789/0", 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "public_addr": "10.20.193.86:6789/0", 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "priority": 0, 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "weight": 0, 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: "crush_location": "{}" 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.073 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "feature_map": { 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "mon": [ 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "client": [ 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:41.074 INFO:teuthology.orchestra.run.trial034.stdout: "num": 45 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: ], 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: "mgr": [ 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: { 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: "features": "0x3f0ffffffffdffff", 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: "release": "squid", 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: "num": 1 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: } 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: ] 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: }, 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout: "stretch_mode": false 2026-02-18T03:51:41.075 INFO:teuthology.orchestra.run.trial034.stdout:} 2026-02-18T03:51:41.077 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:final quorum is size 3 2026-02-18T03:51:41.077 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:triggering scrub 2026-02-18T03:51:41.077 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-18T03:51:41.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:40.835057] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:51:41.322 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:waiting for 60.0 secs before continuing thrashing 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3627539856' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.553 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2339459428' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {auth=60,config=2,health=13,kv=25} crc {auth=210670619,config=509344512,health=2836530372,kv=4212349562}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=932445693}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {kv=82,logm=18} crc {kv=355190060,logm=1323660604}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008979397}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3121684527}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306923017}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3267619643}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3147964869}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1741958527}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1224618246}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4058861303}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1678843229}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738046308}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3584185039}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1578367573}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2245977864}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4092573464}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2077915081}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3923490052}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1329559402}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2990019833}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=563385978}) 2026-02-18T03:51:41.554 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3385882742}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1146779808}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1263949128}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=118524868}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3642297723}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=957943809}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475115987}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1528638696}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889606394}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3150596521}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168679994}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3475677145}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2502185345}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3941890783}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4157109562}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1862846410}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1453320337}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:51:41.555 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568908102}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3373010812}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1789358758}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1691107034}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {logm=55,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=22} crc {logm=971366048,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1174231003}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=2330240297}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=312754910}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=22,mon_config_key=78} crc {mgrstat=2994312412,mon_config_key=396784875}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1486217972}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=44,monmap=5,nvmeofgw=51} crc {mon_config_key=1441318685,monmap=1407976167,nvmeofgw=376858523}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=2882315266}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=89,osd_metadata=8,osd_pg_creating=1,osd_snap=2} crc {nvmeofgw=888909688,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=3904147383}) 2026-02-18T03:51:41.556 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:41 trial034 ceph-mon[125822]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=23} crc {osdmap=3377222986}) 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3627539856' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2339459428' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {auth=60,config=2,health=13,kv=25} crc {auth=210670619,config=509344512,health=2836530372,kv=4212349562}) 2026-02-18T03:51:41.809 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=932445693}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {kv=82,logm=18} crc {kv=355190060,logm=1323660604}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008979397}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3121684527}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306923017}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3267619643}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3147964869}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1741958527}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1224618246}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4058861303}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1678843229}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738046308}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3584185039}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1578367573}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2245977864}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4092573464}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2077915081}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3923490052}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1329559402}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2990019833}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=563385978}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3385882742}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1146779808}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1263949128}) 2026-02-18T03:51:41.810 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=118524868}) 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:51:41] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.811 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:51:41.812 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3642297723}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=957943809}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475115987}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1528638696}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889606394}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3150596521}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168679994}) 2026-02-18T03:51:41.812 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3475677145}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2502185345}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3941890783}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4157109562}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1862846410}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1453320337}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568908102}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3373010812}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1789358758}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1691107034}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {logm=55,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=22} crc {logm=971366048,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1174231003}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=2330240297}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=312754910}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=22,mon_config_key=78} crc {mgrstat=2994312412,mon_config_key=396784875}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1486217972}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=44,monmap=5,nvmeofgw=51} crc {mon_config_key=1441318685,monmap=1407976167,nvmeofgw=376858523}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=2882315266}) 2026-02-18T03:51:41.813 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=89,osd_metadata=8,osd_pg_creating=1,osd_snap=2} crc {nvmeofgw=888909688,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688}) 2026-02-18T03:51:41.814 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=3904147383}) 2026-02-18T03:51:41.814 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-mon[104170]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=23} crc {osdmap=3377222986}) 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.814 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: states { 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: grp_id: 3 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: state: OPTIMIZED 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: } 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: ], , client address: IPv4 10.20.193.155:48300 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.557234] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_26 elapsed time: 0.000161 seconds 2026-02-18T03:51:41.815 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.573160] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_20 elapsed time: 0.000140 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.589187] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000173 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.605205] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000196 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.621148] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000131 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.637194] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000155 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.661170] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000146 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.704254] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.720267] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000145 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.736252] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000144 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.752257] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000144 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.768271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000157 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.792262] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000137 seconds 2026-02-18T03:51:41.816 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.808259] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000144 seconds 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3627539856' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2339459428' entity='client.admin' cmd={"prefix": "mon scrub"} : dispatch 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {auth=60,config=2,health=13,kv=25} crc {auth=210670619,config=509344512,health=2836530372,kv=4212349562}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=100} crc {kv=932445693}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {kv=82,logm=18} crc {kv=355190060,logm=1323660604}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008979397}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3121684527}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306923017}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3267619643}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3147964869}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1741958527}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1224618246}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4058861303}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1678843229}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738046308}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3584185039}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1578367573}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2245977864}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4092573464}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2077915081}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3923490052}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1329559402}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2990019833}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=563385978}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3385882742}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1146779808}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1263949128}) 2026-02-18T03:51:41.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=118524868}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3642297723}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=957943809}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2475115987}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1528638696}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889606394}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3150596521}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168679994}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3475677145}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2502185345}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3941890783}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4157109562}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1862846410}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1453320337}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3155933504}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1825114402}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3488478674}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3362171438}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3079476531}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3759444755}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4211848970}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3354451821}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=913875792}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3077202383}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2835073149}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568908102}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3373010812}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1789358758}) 2026-02-18T03:51:41.875 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1691107034}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {logm=55,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=1,mgrstat=22} crc {logm=971366048,mdsmap=2130286463,mgr=100458968,mgr_command_descs=3109487507,mgr_metadata=1792253160,mgrstat=1174231003}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=2330240297}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=100} crc {mgrstat=312754910}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=22,mon_config_key=78} crc {mgrstat=2994312412,mon_config_key=396784875}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1486217972}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=44,monmap=5,nvmeofgw=51} crc {mon_config_key=1441318685,monmap=1407976167,nvmeofgw=376858523}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=100} crc {nvmeofgw=2882315266}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {nvmeofgw=89,osd_metadata=8,osd_pg_creating=1,osd_snap=2} crc {nvmeofgw=888909688,osd_metadata=2727074769,osd_pg_creating=2918134708,osd_snap=3842414688}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=100} crc {osdmap=3904147383}) 2026-02-18T03:51:41.876 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:41 trial086 ceph-mon[98535]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=23} crc {osdmap=3377222986}) 2026-02-18T03:51:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1157955554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3203699501' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2740752217' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:42 trial086 ceph-mon[98535]: pgmap v867: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 582 KiB/s rd, 3.5 KiB/s wr, 504 op/s 2026-02-18T03:51:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1157955554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3203699501' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2740752217' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:42.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:42 trial155 ceph-mon[104170]: pgmap v867: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 582 KiB/s rd, 3.5 KiB/s wr, 504 op/s 2026-02-18T03:51:43.020 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/1157955554' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3203699501' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2740752217' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:43.021 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:42 trial034 ceph-mon[125822]: pgmap v867: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 582 KiB/s rd, 3.5 KiB/s wr, 504 op/s 2026-02-18T03:51:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:45 trial086 ceph-mon[98535]: pgmap v868: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 567 op/s 2026-02-18T03:51:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:45 trial155 ceph-mon[104170]: pgmap v868: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 567 op/s 2026-02-18T03:51:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:45 trial034 ceph-mon[125822]: pgmap v868: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.0 MiB/s rd, 5.2 KiB/s wr, 567 op/s 2026-02-18T03:51:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:47 trial086 ceph-mon[98535]: pgmap v869: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.4 KiB/s wr, 581 op/s 2026-02-18T03:51:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:47 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2038146602' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:47 trial155 ceph-mon[104170]: pgmap v869: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.4 KiB/s wr, 581 op/s 2026-02-18T03:51:47.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:47 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2038146602' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:47 trial034 ceph-mon[125822]: pgmap v869: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.3 MiB/s rd, 6.4 KiB/s wr, 581 op/s 2026-02-18T03:51:47.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:47 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2038146602' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:49 trial086 ceph-mon[98535]: pgmap v870: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 511 op/s 2026-02-18T03:51:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3690109682' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1094777920' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1982796004' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:49 trial155 ceph-mon[104170]: pgmap v870: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 511 op/s 2026-02-18T03:51:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:49 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3690109682' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:49 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1094777920' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:49 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1982796004' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:49 trial034 ceph-mon[125822]: pgmap v870: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 6.0 KiB/s wr, 511 op/s 2026-02-18T03:51:49.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:49 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3690109682' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:49 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1094777920' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:49.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:49 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1982796004' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:51 trial086 ceph-mon[98535]: pgmap v871: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.8 KiB/s wr, 481 op/s 2026-02-18T03:51:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:51 trial155 ceph-mon[104170]: pgmap v871: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.8 KiB/s wr, 481 op/s 2026-02-18T03:51:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:51 trial034 ceph-mon[125822]: pgmap v871: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 1.2 MiB/s rd, 5.8 KiB/s wr, 481 op/s 2026-02-18T03:51:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:53 trial086 ceph-mon[98535]: pgmap v872: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 936 KiB/s rd, 3.6 KiB/s wr, 178 op/s 2026-02-18T03:51:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:53 trial155 ceph-mon[104170]: pgmap v872: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 936 KiB/s rd, 3.6 KiB/s wr, 178 op/s 2026-02-18T03:51:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:53 trial034 ceph-mon[125822]: pgmap v872: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 936 KiB/s rd, 3.6 KiB/s wr, 178 op/s 2026-02-18T03:51:54.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:54 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2806534379' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:54.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:54 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2806534379' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:54.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:54 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2806534379' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:55 trial086 ceph-mon[98535]: pgmap v873: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 777 KiB/s rd, 2.9 KiB/s wr, 84 op/s 2026-02-18T03:51:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:55 trial155 ceph-mon[104170]: pgmap v873: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 777 KiB/s rd, 2.9 KiB/s wr, 84 op/s 2026-02-18T03:51:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:55 trial034 ceph-mon[125822]: pgmap v873: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 777 KiB/s rd, 2.9 KiB/s wr, 84 op/s 2026-02-18T03:51:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1461265425' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3174760936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/542262400' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:56 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1461265425' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:56 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3174760936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:56 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/542262400' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:56 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/1461265425' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:56 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3174760936' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:56 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/542262400' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:51:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:57 trial086 ceph-mon[98535]: pgmap v874: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 293 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2026-02-18T03:51:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:57 trial155 ceph-mon[104170]: pgmap v874: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 293 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2026-02-18T03:51:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:57 trial034 ceph-mon[125822]: pgmap v874: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 293 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2026-02-18T03:51:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:51:59 trial086 ceph-mon[98535]: pgmap v875: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:51:59 trial155 ceph-mon[104170]: pgmap v875: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:51:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:51:59 trial034 ceph-mon[125822]: pgmap v875: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:01 trial086 ceph-mon[98535]: pgmap v876: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:01 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4213843378' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:01 trial155 ceph-mon[104170]: pgmap v876: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:01 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4213843378' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:01 trial034 ceph-mon[125822]: pgmap v876: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:01.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:01 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/4213843378' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:03 trial086 ceph-mon[98535]: pgmap v877: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 12 op/s 2026-02-18T03:52:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1090884597' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1781164902' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4101016854' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:03 trial155 ceph-mon[104170]: pgmap v877: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 12 op/s 2026-02-18T03:52:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:03 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1090884597' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:03 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1781164902' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:03 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4101016854' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:03 trial034 ceph-mon[125822]: pgmap v877: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 12 op/s 2026-02-18T03:52:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:03 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/1090884597' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:03 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1781164902' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:03.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:03 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/4101016854' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:05 trial086 ceph-mon[98535]: pgmap v878: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:05 trial155 ceph-mon[104170]: pgmap v878: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:05 trial034 ceph-mon[125822]: pgmap v878: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:07 trial086 ceph-mon[98535]: pgmap v879: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:07 trial155 ceph-mon[104170]: pgmap v879: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:07 trial034 ceph-mon[125822]: pgmap v879: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:08.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:08 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1594029231' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:08.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:08 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1594029231' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:08.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:08 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1594029231' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:09 trial086 ceph-mon[98535]: pgmap v880: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:09 trial155 ceph-mon[104170]: pgmap v880: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:09 trial034 ceph-mon[125822]: pgmap v880: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:10 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2789685158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:10 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/911617956' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:10 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1808427460' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:10 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2789685158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:10 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/911617956' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:10 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1808427460' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:10 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2789685158' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:10 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/911617956' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:10.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:10 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1808427460' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:11 trial086 ceph-mon[98535]: pgmap v881: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:11.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:11 trial034 ceph-mon[125822]: pgmap v881: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:11 trial155 ceph-mon[104170]: pgmap v881: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:13 trial086 ceph-mon[98535]: pgmap v882: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:13 trial155 ceph-mon[104170]: pgmap v882: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:13 trial034 ceph-mon[125822]: pgmap v882: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:15 trial086 ceph-mon[98535]: pgmap v883: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:15 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2542604293' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:15 trial155 ceph-mon[104170]: pgmap v883: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:15 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2542604293' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:15.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:15 trial034 ceph-mon[125822]: pgmap v883: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:15.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:15 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2542604293' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:16.584 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:52:16.584 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:52:16.584 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:48:41 UTC; 3min 35s ago 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114053 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114054 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 114131 (conmon) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 602 (limit: 814972) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 344.8M (peak: 347.6M) 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 14min 15.059s 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114133 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114135 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114251 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:52:16.612 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─114525 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout: │ └─114542 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout: └─114131 /usr/bin/conmon --api-version 1 -c 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -u 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata -p /run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: states { 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: grp_id: 3 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: state: INACCESSIBLE 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: } 2026-02-18T03:52:16.613 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:51:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: ], , client address: IPv4 10.20.193.34:34530 2026-02-18T03:52:16.614 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 12min ago 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 358.1M (peak: 361.6M) 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 49min 19.978s 2026-02-18T03:52:16.642 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:52:16.643 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:16.644 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:48:59 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49280 2026-02-18T03:52:16.645 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:52:16.677 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:52:16.677 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:52:16.677 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:51:17 UTC; 59s ago 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105760 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105761 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 105840 (conmon) 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 317.0M (peak: 317.8M) 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 3min 36.838s 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105842 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105844 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105968 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─106252 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: │ └─106257 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: └─105840 /usr/bin/conmon --api-version 1 -c 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -u 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata -p /run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:52:16.678 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.621148] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000131 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.637194] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000155 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.661170] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000146 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.704254] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.720267] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000145 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.736252] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000144 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.752257] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000144 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.768271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000157 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.792262] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000137 seconds 2026-02-18T03:52:16.679 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.808259] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000144 seconds 2026-02-18T03:52:16.680 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:52:16.720 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:52:16.720 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 9min ago 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 375.9M (peak: 380.2M) 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 39min 8.696s 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:52:16.721 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:52:16.722 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:52:16.723 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:52:16.724 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:52:16.950 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:52:16.951 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 3m ago 27m trial034=x;count:1 2026-02-18T03:52:16.951 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 3m ago 27m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:52:16.951 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 9m ago 25m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:52:16.951 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 3m ago 26m trial155 2026-02-18T03:52:16.958 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:52:17.144 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:52:17.144 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (3m) 3m ago 16m 56.6M - 1.6.5 99a57256b38c 0a2f92368348 2026-02-18T03:52:17.144 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (12m) 2m ago 16m 371M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:52:17.144 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (59s) 59s ago 7m 54.7M - 1.6.5 99a57256b38c 62d2283ebd8a 2026-02-18T03:52:17.145 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (9m) 9m ago 16m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:52:17.152 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:52:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:17 trial086 ceph-mon[98535]: pgmap v884: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:17 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3607171083' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:17 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3176742118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:17 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1849455958' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.376 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:52:17.385 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:52:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:17 trial155 ceph-mon[104170]: pgmap v884: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:17 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3607171083' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:17 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3176742118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:17 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1849455958' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:17 trial034 ceph-mon[125822]: pgmap v884: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:17 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3607171083' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:17 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3176742118' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:17 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1849455958' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 39s) [leader: a] 2026-02-18T03:52:17.603 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 27m) 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 26m), 8 in (since 26m) 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: usage: 56 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: client: 112 KiB/s rd, 0 B/s wr, 7 op/s rd, 3 op/s wr 2026-02-18T03:52:17.604 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:52:17.611 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 239, 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 1, 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:52:17.853 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 187, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:52:17.854 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:52:17.855 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:52:17.856 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:52:17.857 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:52:17.857 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:52:17.857 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:52:17.861 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.921 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.922 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.923 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.924 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.925 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.926 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.927 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:52:17.928 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:52:17.974 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:17.976 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:52:18.022 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.023 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:52:18.070 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.072 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:52:18.117 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.118 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:52:18.165 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.166 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:52:18.214 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.215 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:52:18.261 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.262 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:52:18.308 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.309 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:52:18.354 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.355 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='client.144399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='client.140191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4241742664' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1290887314' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1484665105' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:52:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:18 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:18.399 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.401 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:52:18.445 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.446 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:52:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='client.144399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='client.140191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4241742664' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:52:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1290887314' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:52:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1484665105' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:52:18.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:18 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:18.492 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.493 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:52:18.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='client.144399 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='client.140191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:18.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/4241742664' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:52:18.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1290887314' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:52:18.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1484665105' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:52:18.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:18 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:18.538 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.539 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:52:18.583 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.585 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:52:18.630 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.631 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:52:18.676 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.678 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:52:18.722 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.722 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:52:18.808 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.809 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:52:18.855 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.855 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:52:18.900 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.901 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:52:18.945 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.946 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:52:18.990 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:18.992 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:52:19.038 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.038 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:52:19.084 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.084 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:52:19.130 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.131 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:52:19.177 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.178 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:52:19.222 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.223 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:52:19.267 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.268 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:52:19.354 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.355 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:52:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:19 trial086 ceph-mon[98535]: pgmap v885: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:19 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:19 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:19.399 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.401 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:52:19.444 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.445 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:52:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:19 trial155 ceph-mon[104170]: pgmap v885: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:19 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:19 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:19 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:19.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:19 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:19 trial034 ceph-mon[125822]: pgmap v885: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:19 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:19 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:19 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:19.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:19 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:19.532 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.533 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:52:19.578 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.579 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:52:19.625 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.625 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:52:19.670 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.671 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:52:19.716 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.717 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:52:19.761 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.763 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:52:19.806 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.807 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:52:19.894 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.895 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:52:19.939 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.940 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:52:19.985 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:19.986 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:52:20.031 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.032 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:52:20.078 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.078 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:52:20.123 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.124 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:52:20.170 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.171 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:52:20.217 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.219 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:52:20.264 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.266 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:52:20.311 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.312 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:52:20.357 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.358 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:52:20.403 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.404 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:52:20.450 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.451 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:52:20.496 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.497 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:52:20.541 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.542 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:52:20.629 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.629 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:52:20.675 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.676 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:52:20.720 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.721 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:52:20.805 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.806 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:52:20.852 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.853 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:52:20.898 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.898 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:52:20.943 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:20.944 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:52:21.029 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:21.030 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:52:21.075 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:21.076 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:52:21.122 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:21.123 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:52:21.166 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:52:21.167 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:52:21.167 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:52:21.167 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c ... 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.a ... 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.168 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.a 2026-02-18T03:52:21.169 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon stop nvmeof.nvmeof.a 2026-02-18T03:52:21.362 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to stop nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:52:21.371 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.b ... 2026-02-18T03:52:21.372 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.c: thrashed total 4 times, can only thrash 4 times in 1800 seconds. 2026-02-18T03:52:21.372 INFO:tasks.nvmeof.[nvmeof.thrasher]:skipping daemon nvmeof.d ... 2026-02-18T03:52:21.372 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 60 secs before reviving 2026-02-18T03:52:21.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:21 trial086 ceph-mon[98535]: pgmap v886: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:21 trial155 ceph-mon[104170]: pgmap v886: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:21 trial034 ceph-mon[125822]: pgmap v886: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:22.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:21 trial034 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:52:22.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:21] INFO server.py:42 (2): GatewayServer: SIGTERM received signum=15 2026-02-18T03:52:22.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:21] INFO server.py:197 (2): GatewayServer is terminating gracefully... 2026-02-18T03:52:22.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:21] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.34:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.34:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:52:22.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:21 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:21] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:52:22.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='client.144435 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:22.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3472212894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:22.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:22 trial086 ceph-mon[98535]: pgmap v887: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:22.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='client.144435 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:22.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3472212894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:22.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:22 trial155 ceph-mon[104170]: pgmap v887: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='client.144435 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "stop", "name": "nvmeof.nvmeof.a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: Schedule stop daemon nvmeof.nvmeof.a 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:22.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:22.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3472212894' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:22.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:22 trial034 ceph-mon[125822]: pgmap v887: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:52:23.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:52:23.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:52:23.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial034) 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 podman[126847]: 2026-02-18 03:52:23.301126123 +0000 UTC m=+1.661503797 container died 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, release=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, maintainer=Ceph Developers , vcs-type=git, io.spdk.build.target-arch=x86-64-v2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, name=ceph-nvmeof, io.ceph.component=ceph-nvmeof, version=1.6.5, io.spdk.version=25.09, io.ceph.nvmeof=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd) 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 podman[126847]: 2026-02-18 03:52:23.312338548 +0000 UTC m=+1.672716212 container remove 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.version=25.09, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.makeflags=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.nvmeof=, vcs-type=git, io.openshift.wants=ceph,rbd, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, distribution-scope=public, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , release=, name=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, vendor=Red Hat, Inc., org.centos.version=9.0-30.el9, url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git) 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 bash[126847]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:52:23.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:52:23.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 14min 39.960s CPU time, 347.6M memory peak. 2026-02-18T03:52:24.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3659192179' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:24.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:24.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: pgmap v888: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 89 KiB/s rd, 0 B/s wr, 35 op/s 2026-02-18T03:52:24.730 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:24 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1762190087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3659192179' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:24.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:24.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:24.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: pgmap v888: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 89 KiB/s rd, 0 B/s wr, 35 op/s 2026-02-18T03:52:24.772 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:24 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1762190087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:24.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.873 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3659192179' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: pgmap v888: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 89 KiB/s rd, 0 B/s wr, 35 op/s 2026-02-18T03:52:24.874 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:24 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1762190087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:27.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:27 trial086 ceph-mon[98535]: pgmap v889: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 134 KiB/s rd, 0 B/s wr, 67 op/s 2026-02-18T03:52:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:27 trial155 ceph-mon[104170]: pgmap v889: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 134 KiB/s rd, 0 B/s wr, 67 op/s 2026-02-18T03:52:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:27 trial034 ceph-mon[125822]: pgmap v889: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 134 KiB/s rd, 0 B/s wr, 67 op/s 2026-02-18T03:52:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-mon[98535]: pgmap v890: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 97 KiB/s rd, 0 B/s wr, 65 op/s 2026-02-18T03:52:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3948260281' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:29.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-mon[98535]: osdmap e61: 8 total, 8 up, 8 in 2026-02-18T03:52:29.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:52:29] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:52:29.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: OPTIMIZED 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:60236 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.064903] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_12 elapsed time: 0.000143 seconds 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.080795] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000141 seconds 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.096774] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000129 seconds 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.112773] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000124 seconds 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.128784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000139 seconds 2026-02-18T03:52:29.382 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.144788] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.160777] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000132 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.176785] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000140 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.192760] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000113 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.208759] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000113 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.224797] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000147 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.240800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000147 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.256792] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000141 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.280796] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000142 seconds 2026-02-18T03:52:29.383 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.296774] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000119 seconds 2026-02-18T03:52:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:29 trial155 ceph-mon[104170]: pgmap v890: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 97 KiB/s rd, 0 B/s wr, 65 op/s 2026-02-18T03:52:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:29 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3948260281' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:29 trial155 ceph-mon[104170]: osdmap e61: 8 total, 8 up, 8 in 2026-02-18T03:52:29.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:29 trial034 ceph-mon[125822]: pgmap v890: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 97 KiB/s rd, 0 B/s wr, 65 op/s 2026-02-18T03:52:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:29 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3948260281' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:29 trial034 ceph-mon[125822]: osdmap e61: 8 total, 8 up, 8 in 2026-02-18T03:52:30.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:30 trial086 ceph-mon[98535]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:52:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:30 trial155 ceph-mon[104170]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:52:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:30 trial034 ceph-mon[125822]: Health check failed: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. (NVMEOF_GATEWAY_DOWN) 2026-02-18T03:52:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:31 trial086 ceph-mon[98535]: pgmap v892: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 117 KiB/s rd, 0 B/s wr, 78 op/s 2026-02-18T03:52:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3637909374' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:31.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1483409063' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:31 trial155 ceph-mon[104170]: pgmap v892: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 117 KiB/s rd, 0 B/s wr, 78 op/s 2026-02-18T03:52:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:31 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3637909374' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:31.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:31 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1483409063' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:31.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:31 trial034 ceph-mon[125822]: pgmap v892: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 117 KiB/s rd, 0 B/s wr, 78 op/s 2026-02-18T03:52:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:31 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3637909374' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:31 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1483409063' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:33.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:33 trial086 ceph-mon[98535]: pgmap v893: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 106 KiB/s rd, 0 B/s wr, 77 op/s 2026-02-18T03:52:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:33 trial155 ceph-mon[104170]: pgmap v893: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 106 KiB/s rd, 0 B/s wr, 77 op/s 2026-02-18T03:52:33.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:33 trial034 ceph-mon[125822]: pgmap v893: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 106 KiB/s rd, 0 B/s wr, 77 op/s 2026-02-18T03:52:35.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:35 trial086 ceph-mon[98535]: pgmap v894: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 88 KiB/s rd, 0 B/s wr, 45 op/s 2026-02-18T03:52:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:35 trial155 ceph-mon[104170]: pgmap v894: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 88 KiB/s rd, 0 B/s wr, 45 op/s 2026-02-18T03:52:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:35 trial034 ceph-mon[125822]: pgmap v894: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 88 KiB/s rd, 0 B/s wr, 45 op/s 2026-02-18T03:52:36.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:36 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3437098420' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:36.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:36 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3437098420' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:36.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:36 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3437098420' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:37 trial086 ceph-mon[98535]: pgmap v895: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 68 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:52:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:37 trial155 ceph-mon[104170]: pgmap v895: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 68 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:52:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:37 trial034 ceph-mon[125822]: pgmap v895: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 68 KiB/s rd, 0 B/s wr, 9 op/s 2026-02-18T03:52:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2741865583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1031232409' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:38 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2741865583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:38 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1031232409' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:38.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2741865583' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1031232409' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:39 trial086 ceph-mon[98535]: pgmap v896: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 67 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:39 trial155 ceph-mon[104170]: pgmap v896: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 67 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:39.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:39 trial034 ceph-mon[125822]: pgmap v896: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 67 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:52:41.323 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: waiting for others thrashers 2026-02-18T03:52:41.323 INFO:tasks.mon_thrash.[nvmeof.thrasher.mon_thrasher]:switch_task: done waiting for the other thrasher 2026-02-18T03:52:41.324 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-18T03:52:41.324 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-18T03:52:41.350 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:41 trial034 ceph-mon[125822]: pgmap v897: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 59 KiB/s rd, 0 B/s wr, 6 op/s 2026-02-18T03:52:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:41 trial086 ceph-mon[98535]: pgmap v897: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 59 KiB/s rd, 0 B/s wr, 6 op/s 2026-02-18T03:52:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:41 trial155 ceph-mon[104170]: pgmap v897: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 59 KiB/s rd, 0 B/s wr, 6 op/s 2026-02-18T03:52:41.551 INFO:teuthology.orchestra.run.trial034.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_leader_name":"a","quorum_age":63,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":3,"fsid":"3ff67590-0c79-11f1-9051-d404e6e7d460","modified":"2026-02-18T03:24:53.237470Z","created":"2026-02-18T03:24:08.615934Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:3300","nonce":0},{"type":"v1","addr":"10.20.193.34:6789","nonce":0}]},"addr":"10.20.193.34:6789/0","public_addr":"10.20.193.34:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:3300","nonce":0},{"type":"v1","addr":"10.20.193.155:6789","nonce":0}]},"addr":"10.20.193.155:6789/0","public_addr":"10.20.193.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:3300","nonce":0},{"type":"v1","addr":"10.20.193.86:6789","nonce":0}]},"addr":"10.20.193.86:6789/0","public_addr":"10.20.193.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-18T03:52:41.561 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-18T03:52:41.561 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof.thrash 2026-02-18T03:52:41.578 INFO:tasks.nvmeof:joining nvmeof.thrash 2026-02-18T03:52:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1301959397' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:52:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1301959397' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:52:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/1301959397' entity='client.admin' cmd={"prefix": "quorum_status"} : dispatch 2026-02-18T03:52:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:43 trial086 ceph-mon[98535]: pgmap v898: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:43 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/659999744' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:43 trial155 ceph-mon[104170]: pgmap v898: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:43 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/659999744' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:43 trial034 ceph-mon[125822]: pgmap v898: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:43.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:43 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/659999744' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:45 trial086 ceph-mon[98535]: pgmap v899: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1634063170' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/4028768138' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:45 trial155 ceph-mon[104170]: pgmap v899: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:45 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1634063170' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:45 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/4028768138' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:45 trial034 ceph-mon[125822]: pgmap v899: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:45 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1634063170' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:45 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/4028768138' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:47 trial086 ceph-mon[98535]: pgmap v900: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:47 trial155 ceph-mon[104170]: pgmap v900: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:47 trial034 ceph-mon[125822]: pgmap v900: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:49 trial086 ceph-mon[98535]: pgmap v901: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:49 trial155 ceph-mon[104170]: pgmap v901: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:49 trial034 ceph-mon[125822]: pgmap v901: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:50.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:50 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/4264888688' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:50.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:50 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/4264888688' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:50.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:50 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/4264888688' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:51 trial086 ceph-mon[98535]: pgmap v902: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:51 trial155 ceph-mon[104170]: pgmap v902: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:51 trial034 ceph-mon[125822]: pgmap v902: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3657913969' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1127813035' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3657913969' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1127813035' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:52.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3657913969' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1127813035' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:53 trial086 ceph-mon[98535]: pgmap v903: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:53 trial155 ceph-mon[104170]: pgmap v903: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:53 trial034 ceph-mon[125822]: pgmap v903: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:55 trial086 ceph-mon[98535]: pgmap v904: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:55 trial155 ceph-mon[104170]: pgmap v904: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:55 trial034 ceph-mon[125822]: pgmap v904: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:57 trial086 ceph-mon[98535]: pgmap v905: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:57 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2208729965' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:57 trial155 ceph-mon[104170]: pgmap v905: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:57 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2208729965' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:57 trial034 ceph-mon[125822]: pgmap v905: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:52:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:57 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2208729965' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:59 trial086 ceph-mon[98535]: pgmap v906: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3817541311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:52:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2287634955' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:59 trial155 ceph-mon[104170]: pgmap v906: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:59 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3817541311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:52:59 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2287634955' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:59 trial034 ceph-mon[125822]: pgmap v906: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:52:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:59 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3817541311' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:52:59.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:52:59 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2287634955' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:01 trial086 ceph-mon[98535]: pgmap v907: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:01 trial155 ceph-mon[104170]: pgmap v907: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:01 trial034 ceph-mon[125822]: pgmap v907: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:03 trial086 ceph-mon[98535]: pgmap v908: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:03.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:03 trial155 ceph-mon[104170]: pgmap v908: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:03 trial034 ceph-mon[125822]: pgmap v908: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:04.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:04 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1110148336' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:04.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:04 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1110148336' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:04.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:04 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1110148336' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:05 trial086 ceph-mon[98535]: pgmap v909: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:05 trial155 ceph-mon[104170]: pgmap v909: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:05.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:05 trial034 ceph-mon[125822]: pgmap v909: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3916649565' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/1116774249' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:06 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3916649565' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:06 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/1116774249' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:06 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3916649565' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:06 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/1116774249' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:07 trial086 ceph-mon[98535]: pgmap v910: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:07 trial155 ceph-mon[104170]: pgmap v910: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:07 trial034 ceph-mon[125822]: pgmap v910: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:09 trial086 ceph-mon[98535]: pgmap v911: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:09 trial155 ceph-mon[104170]: pgmap v911: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:09 trial034 ceph-mon[125822]: pgmap v911: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:11 trial086 ceph-mon[98535]: pgmap v912: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:11 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/556729821' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:11 trial155 ceph-mon[104170]: pgmap v912: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:11 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/556729821' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:11.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:11 trial034 ceph-mon[125822]: pgmap v912: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:11.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:11 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/556729821' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:13 trial086 ceph-mon[98535]: pgmap v913: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3906789016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:13 trial155 ceph-mon[104170]: pgmap v913: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:13 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3906789016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:13 trial034 ceph-mon[125822]: pgmap v913: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:13.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:13 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3906789016' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:14 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2204896087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:14 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2204896087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:14.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:14 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2204896087' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:15 trial086 ceph-mon[98535]: pgmap v914: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:15 trial155 ceph-mon[104170]: pgmap v914: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:15 trial034 ceph-mon[125822]: pgmap v914: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:17 trial086 ceph-mon[98535]: pgmap v915: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:17 trial155 ceph-mon[104170]: pgmap v915: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:17.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:17 trial034 ceph-mon[125822]: pgmap v915: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:18.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:18 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3868066567' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:18.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:18 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3868066567' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:18.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:18 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3868066567' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:19 trial086 ceph-mon[98535]: pgmap v916: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:19 trial155 ceph-mon[104170]: pgmap v916: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:19 trial034 ceph-mon[125822]: pgmap v916: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:20 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3096678278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:20.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:20 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3096678278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:20.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3096678278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:21.372 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before reviving - iteration #9: thrashed- nvmeof.a (by ceph_daemon_stop); 2026-02-18T03:53:21.373 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:53:21.373 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:53:21.397 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:21 trial034 ceph-mon[125822]: pgmap v917: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:21.398 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:21 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/176269116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout:○ ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Active: inactive (dead) since Wed 2026-02-18 03:52:23 UTC; 58s ago 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Duration: 3min 40.551s 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114053 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Process: 114054 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.405 INFO:teuthology.orchestra.run.trial034.stdout: Process: 126812 ExecStop=/bin/bash -c bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.stop (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout: Process: 126883 ExecStopPost=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.poststop (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout: Process: 126920 ExecStopPost=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 114131 (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 14min 39.960s 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO server.py:245 (2): Exiting the gateway process. 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[114131]: [18-Feb-2026 03:52:23] INFO utils.py:560 (2): Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2026-02-18T03:53:21.406 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 podman[126847]: 2026-02-18 03:52:23.301126123 +0000 UTC m=+1.661503797 container died 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, architecture=x86_64, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, release=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, maintainer=Ceph Developers , vcs-type=git, io.spdk.build.target-arch=x86-64-v2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, name=ceph-nvmeof, io.ceph.component=ceph-nvmeof, version=1.6.5, io.spdk.version=25.09, io.ceph.nvmeof=, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, url=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd) 2026-02-18T03:53:21.407 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 podman[126847]: 2026-02-18 03:52:23.312338548 +0000 UTC m=+1.672716212 container remove 0a2f92368348821b8859574185c695c8bdb8e7cc3d70efd304c1a8d3b69c86cf (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.version=25.09, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.makeflags=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.ceph-release=20.2.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.nvmeof=, vcs-type=git, io.openshift.wants=ceph,rbd, architecture=x86_64, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.component=ubi9-container, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, distribution-scope=public, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.maintainer=Ceph Developers , release=, name=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.spdk.build.pkgdep-args=--rbd, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.target-arch=x86-64-v2, vendor=Red Hat, Inc., org.centos.version=9.0-30.el9, url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , io.buildah.version=1.29.0, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.component=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git) 2026-02-18T03:53:21.407 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 bash[126847]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T03:53:21.407 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Deactivated successfully. 2026-02-18T03:53:21.407 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:53:21.407 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:52:23 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 14min 39.960s CPU time, 347.6M memory peak. 2026-02-18T03:53:21.408 DEBUG:teuthology.orchestra.run:got remote process result: 3 2026-02-18T03:53:21.408 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:53:21.430 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:21 trial086 ceph-mon[98535]: pgmap v917: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:21.430 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/176269116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:21.437 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:21.437 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 13min ago 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 359.4M (peak: 362.6M) 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 53min 38.963s 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.438 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.144788] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.160777] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_6 elapsed time: 0.000132 seconds 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.176785] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_19 elapsed time: 0.000140 seconds 2026-02-18T03:53:21.439 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.192760] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000113 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.208759] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000113 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.224797] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000147 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.240800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000147 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.256792] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000141 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.280796] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000142 seconds 2026-02-18T03:53:21.440 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:52:29 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:52:29.296774] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_2 elapsed time: 0.000119 seconds 2026-02-18T03:53:21.441 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:53:21.464 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:21 trial155 ceph-mon[104170]: pgmap v917: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:21.464 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:21 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/176269116' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:51:17 UTC; 2min 4s ago 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105760 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105761 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 105840 (conmon) 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:53:21.472 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 330.1M (peak: 332.1M) 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 7min 55.924s 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105842 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105844 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105968 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─106252 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: │ └─106257 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:53:21.473 INFO:teuthology.orchestra.run.trial155.stdout: └─105840 /usr/bin/conmon --api-version 1 -c 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -u 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata -p /run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.621148] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000131 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.637194] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000155 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.661170] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000146 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.704254] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.720267] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000145 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.736252] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000144 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.752257] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000144 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.768271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000157 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.792262] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000137 seconds 2026-02-18T03:53:21.474 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.808259] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000144 seconds 2026-02-18T03:53:21.476 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:53:21.503 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:21.503 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:53:21.503 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 10min ago 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 377.8M (peak: 380.4M) 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 43min 27.645s 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.504 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:53:21.505 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:53:21.506 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:53:21.506 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:53:21.506 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:53:21.506 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:53:21.506 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:53:21.507 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:53:21.733 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:53:21.733 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 57s ago 28m trial034=x;count:1 2026-02-18T03:53:21.733 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 3m ago 28m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:53:21.733 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 3/4 10m ago 26m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:53:21.733 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 3m ago 27m trial155 2026-02-18T03:53:21.741 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:53:21.924 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:53:21.925 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 stopped 58s ago 17m - - 2026-02-18T03:53:21.925 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (13m) 3m ago 17m 371M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:53:21.925 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (2m) 2m ago 9m 54.7M - 1.6.5 99a57256b38c 62d2283ebd8a 2026-02-18T03:53:21.925 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (10m) 10m ago 17m 52.9M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:53:21.933 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:53:22.154 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_WARN 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:53:22.155 INFO:teuthology.orchestra.run.trial177.stdout:[WRN] NVMEOF_GATEWAY_DOWN: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:53:22.155 INFO:teuthology.orchestra.run.trial177.stdout: NVMeoF Gateway 'client.nvmeof.nvmeof.a' is unavailable. 2026-02-18T03:53:22.163 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:53:22.382 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:53:22.382 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:22.382 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_WARN 2026-02-18T03:53:22.382 INFO:teuthology.orchestra.run.trial177.stdout: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy. 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 103s) [leader: a] 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 28m) 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 27m), 8 in (since 27m) 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 3 gateways active (3 hosts) 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:53:22.383 INFO:teuthology.orchestra.run.trial177.stdout: usage: 56 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:53:22.384 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:53:22.384 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:53:22.384 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:53:22.384 INFO:teuthology.orchestra.run.trial177.stdout: client: 84 KiB/s rd, 0 B/s wr, 5 op/s rd, 2 op/s wr 2026-02-18T03:53:22.384 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:53:22.390 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 241, 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:53:22.633 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 2, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 190, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 0, 2026-02-18T03:53:22.634 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "UNAVAILABLE", 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:53:22.635 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:53:22.636 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:53:22.637 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:53:22.637 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:53:22.637 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:53:22.637 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:53:22.637 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:53:22.641 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.699 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.700 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.701 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.702 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.703 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.704 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.705 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.705 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:53:22.706 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:53:22.751 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.752 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:53:22.796 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.797 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:53:22.842 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.844 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:53:22.889 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.889 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:53:22.934 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.935 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:53:22.981 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:22.982 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:53:23.027 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.028 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:53:23.072 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.074 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:53:23.119 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.120 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:53:23.165 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.167 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:53:23.212 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.213 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:53:23.258 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.259 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:53:23.303 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.304 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:53:23.406 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.407 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:53:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: from='client.140359 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: from='client.144576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: pgmap v918: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:23.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2161097536' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:53:23.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/4121291417' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:53:23.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:23 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2616996450' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:53:23.493 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.494 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:53:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: from='client.140359 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: from='client.144576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: pgmap v918: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2161097536' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:53:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/4121291417' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:53:23.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2616996450' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:53:23.580 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.580 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: from='client.140359 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: from='client.144576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: pgmap v918: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2161097536' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/4121291417' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:53:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2616996450' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:53:23.665 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.666 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:53:23.710 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.711 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:53:23.797 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.798 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:53:23.844 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.845 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:53:23.890 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.891 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:53:23.975 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:23.976 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:53:24.064 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.065 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:53:24.113 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.114 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:53:24.161 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.162 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:53:24.208 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.209 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:53:24.257 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.258 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:53:24.303 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.304 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:53:24.350 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.350 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:53:24.396 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.397 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:53:24.442 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.443 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:53:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:24 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:24.487 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.488 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:53:24.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:24 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:24.533 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.534 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:53:24.579 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.580 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:53:24.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:24 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:24.626 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.627 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:53:24.672 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.672 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:53:24.756 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.757 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:53:24.803 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.804 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:53:24.850 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.851 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:53:24.896 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.897 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:53:24.941 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.942 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:53:24.987 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:24.988 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:53:25.034 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.034 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:53:25.081 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.082 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:53:25.128 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.129 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:53:25.175 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.175 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:53:25.221 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.222 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:53:25.267 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.268 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:53:25.314 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.315 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:53:25.360 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.361 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:53:25.406 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.407 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:53:25.451 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.453 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:53:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: pgmap v919: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:25.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:25.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:25.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:25 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3013666333' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:25.498 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.499 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:53:25.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: pgmap v919: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:25 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3013666333' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:25.545 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.545 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:53:25.591 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.592 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:53:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: pgmap v919: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:25.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:25.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:25.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:25 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3013666333' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:25.637 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.639 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:53:25.684 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.685 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:53:25.730 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.731 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:53:25.776 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.778 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:53:25.822 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.824 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:53:25.869 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.870 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:53:25.915 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.917 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:53:25.962 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:25.963 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:53:26.008 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:53:26.010 INFO:tasks.nvmeof.[nvmeof.thrasher]:reviving nvmeof.a 2026-02-18T03:53:26.010 DEBUG:teuthology.orchestra.run.trial034:> ceph orch daemon restart nvmeof.nvmeof.a --force 2026-02-18T03:53:26.202 INFO:teuthology.orchestra.run.trial034.stdout:Scheduled to restart nvmeof.nvmeof.a on host 'trial034' 2026-02-18T03:53:26.213 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 84 secs before thrashing 2026-02-18T03:53:26.879 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 systemd[1]: Starting Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:53:26.879 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 podman[127674]: 2026-02-18 03:53:26.664025163 +0000 UTC m=+0.018064525 container create 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vendor=Red Hat, Inc., io.ceph.component=ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, release=, maintainer=Ceph Developers , com.redhat.component=ubi9-container, io.spdk.build.target-arch=x86-64-v2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, org.centos.version=9.0-30.el9, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2026-02-11 09:53:49 UTC, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.openshift.wants=ceph,rbd, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.branch=undefined, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, distribution-scope=public, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.maintainer=Ceph Developers , url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, name=ceph-nvmeof, io.ceph.version=1.6.5) 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 podman[127674]: 2026-02-18 03:53:26.698319414 +0000 UTC m=+0.052358776 container init 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.spdk.git.branch=undefined, io.spdk.git.repo=https://github.com/ceph/spdk.git, maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.spdk.build.makeflags=, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-type=git, io.openshift.wants=ceph,rbd, io.spdk.build.target-arch=x86-64-v2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, io.ceph.nvmeof=, distribution-scope=public, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., io.spdk.version=25.09, architecture=x86_64, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, org.centos.version=9.0-30.el9, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, io.ceph.component=ceph-nvmeof, io.ceph.version=1.6.5, release=, io.buildah.version=1.29.0, io.ceph.maintainer=Ceph Developers ) 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 podman[127674]: 2026-02-18 03:53:26.700689764 +0000 UTC m=+0.054729126 container start 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, io.openshift.wants=ceph,rbd, architecture=x86_64, io.ceph.component=ceph-nvmeof, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.buildah.version=1.29.0, distribution-scope=public, maintainer=Ceph Developers , io.spdk.build.pkgdep-args=--rbd, io.ceph.git.branch=devel, io.spdk.build.ceph-release=20.2.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-type=git, version=1.6.5, summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.git.branch=undefined, release=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, io.spdk.build.target-arch=x86-64-v2, name=ceph-nvmeof, org.centos.version=9.0-30.el9, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2026-02-11 09:53:49 UTC) 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 bash[127674]: 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 podman[127674]: 2026-02-18 03:53:26.656128484 +0000 UTC m=+0.010167846 image pull 99a57256b38c2d09c379d7a7dea149f0683813deeaea19d051181a655ae79f39 quay.io/ceph/nvmeof:devel 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 systemd[1]: Started Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO utils.py:421 (2): Initialize gateway log level to "INFO" 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO utils.py:436 (2): Log files will be saved in /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a, using rotation 2026-02-18T03:53:26.880 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:86 (2): Using NVMeoF gateway version 1.6.5 2026-02-18T03:53:26.881 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:89 (2): Configured SPDK version 25.09 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:92 (2): Using vstart cluster version based on 20.2.0 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:95 (2): NVMeoF gateway built on: 2026-02-11 09:53:49 UTC 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:98 (2): NVMeoF gateway Git repository: https://github.com/ceph/ceph-nvmeof 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:101 (2): NVMeoF gateway Git branch: devel 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:104 (2): NVMeoF gateway Git commit: 94482f18983f54f577e95f27ee3e5f5e145c7fd2 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:110 (2): SPDK Git repository: https://github.com/ceph/spdk.git 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:113 (2): SPDK Git branch: undefined 2026-02-18T03:53:27.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:116 (2): SPDK Git commit: 60b5c24409cdabac02c09cbe18cc0ab7a38690e8 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:65 (2): Using configuration file /src/ceph-nvmeof.conf 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:67 (2): ====================================== Configuration file content ====================================== 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This file is generated by cephadm. 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [gateway] 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): name = client.nvmeof.nvmeof.a 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): group = mygroup0 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): port = 5500 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): enable_auth = False 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): state_update_notify = True 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): state_update_interval_sec = 5 2026-02-18T03:53:27.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): break_update_interval_sec = 25 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): enable_spdk_discovery_controller = False 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): encryption_key = /encryption.key 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): rebalance_period_sec = 7 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_gws_in_grp = 16 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_ns_to_change_lb_grp = 8 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): enable_prometheus_exporter = True 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): prometheus_exporter_ssl = False 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): prometheus_port = 10008 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): prometheus_stats_interval = 10 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): prometheus_startup_delay = 240 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): prometheus_connection_list_cache_expiration = 60 2026-02-18T03:53:27.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): verify_nqns = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): verify_keys = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): verify_listener_ip = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): abort_on_update_error = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_ignore_unlock_errors = False 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_lock_on_read = True 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_lock_duration = 20 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_lock_retries = 30 2026-02-18T03:53:27.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_lock_retry_sleep_interval = 1.0 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): omap_file_update_reloads = 10 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): allowed_consecutive_spdk_ping_failures = 1 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): spdk_ping_interval_in_seconds = 2.0 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): ping_spdk_under_lock = False 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): enable_monitor_client = True 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_hosts_per_namespace = 16 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_namespaces_with_netmask = 1000 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_subsystems = 128 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_hosts = 2048 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_namespaces = 4096 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_namespaces_per_subsystem = 512 2026-02-18T03:53:27.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_hosts_per_subsystem = 128 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): subsystem_cache_expiration = 5 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): force_tls = False 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_message_length_in_mb = 4 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [gateway-logs] 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): log_level = INFO 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): log_files_enabled = True 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): log_files_rotation_enabled = True 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): verbose_log_messages = True 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_log_file_size_in_mb = 10 2026-02-18T03:53:27.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_log_files_count = 20 2026-02-18T03:53:27.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): max_log_directory_backups = 10 2026-02-18T03:53:27.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): log_directory = /var/log/ceph/ 2026-02-18T03:53:27.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [discovery] 2026-02-18T03:53:27.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): addr = 10.20.193.34 2026-02-18T03:53:27.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): port = 8009 2026-02-18T03:53:27.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): # This is a development flag, do not change it 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): abort_on_errors = True 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): bind_retries_limit = 10 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): bind_sleep_interval = 0.5 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [ceph] 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): pool = mypool 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): config_file = /etc/ceph/ceph.conf 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): id = nvmeof.nvmeof.a 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [mtls] 2026-02-18T03:53:27.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): server_key = /server.key 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): client_key = /client.key 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): server_cert = /server.cert 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): client_cert = /client.cert 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): root_ca_cert = /root.ca.cert 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [spdk] 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): tgt_path = /usr/local/bin/nvmf_tgt 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): rpc_socket_dir = /var/tmp/ 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): rpc_socket_name = spdk.sock 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): timeout = 60.0 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): cluster_connections = 32 2026-02-18T03:53:27.207 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): protocol_log_level = WARNING 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): conn_retries = 10 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): transports = tcp 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7} 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): enable_dsa_acceleration = False 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): qos_timeslice_in_usecs = 0 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): notifications_interval = 60 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): [monitor] 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:72 (2): timeout = 1.0 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO config.py:73 (2): ======================================================================================================== 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] WARNING server.py:151 (2): No valid encryption key file was set. Any attempt to encrypt or decrypt keys would fail 2026-02-18T03:53:27.208 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:163 (2): Starting gateway client.nvmeof.nvmeof.a 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:297 (2): Starting serve, monitor client version: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO state.py:894 (2): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:897 (2): DSA acceleration device configuration is disabled 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:424 (2): Starting /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:430 (2): monitor client process id: 19 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:264 (2): MonitorGroup server is listening on 10.20.193.34:5499 for group id 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:253 (2): Gateway client.nvmeof.nvmeof.a group id=0 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:268 (2): Stopping the MonitorGroup server... 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:271 (2): The MonitorGroup gRPC server has stopped... 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:576 (2): SPDK Target Path: /usr/local/bin/nvmf_tgt 2026-02-18T03:53:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:593 (2): SPDK Socket: /var/tmp/spdk.sock 2026-02-18T03:53:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:612 (2): SPDK will use huge pages, probing... 2026-02-18T03:53:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:1022 (2): Requested huge pages count is 2048 2026-02-18T03:53:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:1042 (2): Actual huge pages count is 4096 2026-02-18T03:53:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:619 (2): SPDK autodetecting core list: --lcores (0-3) 2026-02-18T03:53:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:26 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:26] INFO server.py:633 (2): Starting /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores (0-3) 2026-02-18T03:53:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: pgmap v920: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='client.144603 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3365976571' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:27.480 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:27 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/326504953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: pgmap v920: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='client.144603 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:27.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3365976571' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:27.522 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:27 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/326504953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: pgmap v920: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 84 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-18T03:53:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='client.144603 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "restart", "name": "nvmeof.nvmeof.a", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:53:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: Schedule restart daemon nvmeof.nvmeof.a 2026-02-18T03:53:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3365976571' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:27.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/326504953' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:28 trial155 ceph-mon[104170]: pgmap v921: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:28.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-mon[125822]: pgmap v921: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:53:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:28 trial086 ceph-mon[98535]: pgmap v921: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 56 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-18T03:53:29.239 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:28] INFO server.py:656 (2): SPDK process id: 73 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:28] INFO server.py:659 (2): Attempting to initialize SPDK: rpc_socket: /var/tmp/spdk.sock, conn_retries: 300, timeout: 60.0, log level: WARNING 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: INFO: Setting log level to WARNING 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:28] INFO client.py:121 (2): Setting log level to WARNING 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:28.965979] Starting SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e / DPDK 25.07.0 initialization... 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:28 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:28.966026] [ DPDK EAL parameters: nvmf --no-shconf --lcores=(0-3) --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73 ] 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.082540] app.c: 964:spdk_app_start: *NOTICE*: Total cores available: 4 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.111882] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 1 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.111892] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 2 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.111900] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 3 2026-02-18T03:53:29.240 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.111901] reactor.c: 996:reactor_run: *NOTICE*: Reactor started on core 0 2026-02-18T03:53:29.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:886 (2): Set RBD CRC32C usage to: False 2026-02-18T03:53:29.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:906 (2): DSA acceleration module scanning is disabled 2026-02-18T03:53:29.241 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.238169] tcp.c: 822:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 2026-02-18T03:53:29.495 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-mon[125822]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:53:29.495 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-mon[125822]: Cluster is now healthy 2026-02-18T03:53:29.495 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/657187101' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:53:29.495 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/688359672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:29.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:721 (2): Started SPDK with version "SPDK v25.09 git sha1 8912a2b3b94c62d0ae92b38386946cad76c2698e" 2026-02-18T03:53:29.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:473 (2): Discovery service process id: 78 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:461 (78): Starting ceph nvmeof discovery service 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO cephutils.py:186 (2): Connected to Ceph with version "20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - Debug)" 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO cephutils.py:189 (2): Cluster ID is 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO cluster.py:196 (2): NVMeoF cluster pool size: 32 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO rebalance.py:36 (2): Starting rebalance thread: period: 7, max number ns to move: 8 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:970 (2): Will enable gateway's IO statistics 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:7290 (2): Received request to set gateway's IO statistics mode, enabled: True 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO state.py:894 (78): nvmeof.mygroup0.state OMAP object already exists. 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO discovery.py:344 (78): log pages info from omap: nvmeof.mygroup0.state 2026-02-18T03:53:29.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO discovery.py:369 (78): discovery addr: 10.20.193.34 port: 8009 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.285379] tcp.c:3713:nvmf_tcp_enable_stats: *NOTICE*: Allocated pool for IO statistics pool size 65536 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.285413] tcp.c:3722:nvmf_tcp_enable_stats: *NOTICE*: IO Statistics enable = 1 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO cephutils.py:308 (2): Registered nvmeof.a to service_map! 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:278 (2): Prometheus exporter endpoint is enabled 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:283 (2): Delaying Prometheus exporter startup by 240 seconds... 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO server.py:290 (2): Prometheus exporter startup scheduled in background 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO state.py:1684 (78): Start update from 1 to 161 (discovery-trial034). 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO state.py:2068 (78): Update complete (1 -> 161) (discovery-trial034). 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO state.py:2073 (78): Initialization is over (discovery-trial034). 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO state.py:1684 (2): Start update from 1 to 161 (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode16, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode9, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode15, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode12, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode14, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode5, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode7, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode8, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode10, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode6, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.499 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode4, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode13, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1817 (2): Received request to create subsystem nqn.2016-06.io.spdk:cnode11, enable_ha: True, max_namespaces: 512, no group append: True, network mask: [], secure listeners: False, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode12, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode12 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode16, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode16 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode7, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode7 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode4, context: None 2026-02-18T03:53:29.500 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode4 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode11, context: None 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode11 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode13, context: None 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode13 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode8, context: None 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode8 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode9, context: None 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode9 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2026-02-18T03:53:29.501 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode3 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:29 trial086 ceph-mon[98535]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:53:29.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:29 trial086 ceph-mon[98535]: Cluster is now healthy 2026-02-18T03:53:29.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:29 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/657187101' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:53:29.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:29 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/688359672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:29.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:29 trial155 ceph-mon[104170]: Health check cleared: NVMEOF_GATEWAY_DOWN (was: 1 gateway(s) are in unavailable state; gateway might be down, try to redeploy.) 2026-02-18T03:53:29.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:29 trial155 ceph-mon[104170]: Cluster is now healthy 2026-02-18T03:53:29.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:29 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/657187101' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2026-02-18T03:53:29.729 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:29 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/688359672' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode14, context: None 2026-02-18T03:53:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode14 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode5, context: None 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode5 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode10, context: None 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode10 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode6, context: None 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode6 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode2 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode1 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:4801 (2): Received request to allow any host access for nqn.2016-06.io.spdk:cnode15, context: None 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] WARNING grpc.py:4850 (2): Subsystem nqn.2016-06.io.spdk:cnode15 will be opened to be accessed from any host. This might be a security breach 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode14, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d71c5a89-7e6c-4076-91b4-767d995215ee from mypool/myimage54 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.601808] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_1, nonce 10.20.193.34:0/3456734670, rc 0 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.602073] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_1, nonce 10.20.193.34:0/3456734670 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_1' nonce='10.20.193.34:0/3456734670' 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.617363] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2517 (2): Received request to add bdev_d71c5a89-7e6c-4076-91b4-767d995215ee to nqn.2016-06.io.spdk:cnode14 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage54, context: None 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.621998] subsystem_rbd_resrv.c: 52:spdk_try_rbd_reservation_ops_set: *NOTICE*: reservation custom ops set for for bdev_rbd 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.622695] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage54 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.622709] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode5, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd from mypool/myimage18 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.733854] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_2, nonce 10.20.193.34:0/552722636, rc 0 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.733929] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_2, nonce 10.20.193.34:0/552722636 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_2' nonce='10.20.193.34:0/552722636' 2026-02-18T03:53:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.747370] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2517 (2): Received request to add bdev_e9e9229a-542b-40ef-b0a9-8385c134c9cd to nqn.2016-06.io.spdk:cnode5 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage18, context: None 2026-02-18T03:53:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.752764] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage18 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.752786] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode15, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_660338e1-54dd-4121-996a-f406d11bb4bd from mypool/myimage60 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.851995] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_3, nonce 10.20.193.34:0/2160806094, rc 0 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.852053] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_3, nonce 10.20.193.34:0/2160806094 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_3' nonce='10.20.193.34:0/2160806094' 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.866073] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_660338e1-54dd-4121-996a-f406d11bb4bd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2517 (2): Received request to add bdev_660338e1-54dd-4121-996a-f406d11bb4bd to nqn.2016-06.io.spdk:cnode15 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage60, context: None 2026-02-18T03:53:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.884361] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage60 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.884389] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode3, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b07835bf-2357-4779-83d0-25e8667bb213 from mypool/myimage11 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.987850] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_4, nonce 10.20.193.34:0/3687445761, rc 0 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:29.987910] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_4, nonce 10.20.193.34:0/3687445761 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:29] INFO grpc.py:1263 (2): Allocated cluster name='cluster_4' nonce='10.20.193.34:0/3687445761' 2026-02-18T03:53:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.002252] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b07835bf-2357-4779-83d0-25e8667bb213 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_b07835bf-2357-4779-83d0-25e8667bb213 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage11, context: None 2026-02-18T03:53:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.006814] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage11 2026-02-18T03:53:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.006835] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode1, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 from mypool/myimage3 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.106423] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_5, nonce 10.20.193.34:0/2252656363, rc 0 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.111103] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_5, nonce 10.20.193.34:0/2252656363 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_5' nonce='10.20.193.34:0/2252656363' 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.124019] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_8126d615-fbb1-4a3b-a258-1ef1d6873559 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage3, context: None 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.128589] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage3 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.128609] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode1, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_72416b18-e396-4424-a59d-78fd125f59ac from mypool/myimage2 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.224330] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_6, nonce 10.20.193.34:0/70905552, rc 0 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.224411] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_6, nonce 10.20.193.34:0/70905552 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_6' nonce='10.20.193.34:0/70905552' 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.236625] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_72416b18-e396-4424-a59d-78fd125f59ac rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_72416b18-e396-4424-a59d-78fd125f59ac to nqn.2016-06.io.spdk:cnode1 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage2, context: None 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.241429] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage2 2026-02-18T03:53:30.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.241453] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:30.557 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-mon[125822]: pgmap v922: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 65 KiB/s rd, 85 B/s wr, 16 op/s 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode3, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_7776dad8-760d-459d-b062-e6dd78a63f1b from mypool/myimage12 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.336990] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_7, nonce 10.20.193.34:0/3561191431, rc 0 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.337052] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_7, nonce 10.20.193.34:0/3561191431 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_7' nonce='10.20.193.34:0/3561191431' 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.351151] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_7776dad8-760d-459d-b062-e6dd78a63f1b to nqn.2016-06.io.spdk:cnode3 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage12, context: None 2026-02-18T03:53:30.558 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.356207] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage12 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.356227] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode9, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 from mypool/myimage33 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.447963] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_8, nonce 10.20.193.34:0/3141376605, rc 0 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.448022] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_8, nonce 10.20.193.34:0/3141376605 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_8' nonce='10.20.193.34:0/3141376605' 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.459701] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_f6bf2154-c4fc-4a5c-b7fd-2896cb46ab41 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage33, context: None 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.464229] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage33 2026-02-18T03:53:30.559 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.464250] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:30.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode7, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 from mypool/myimage28 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.560 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.556024] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_9, nonce 10.20.193.34:0/2892908006, rc 0 2026-02-18T03:53:30.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:30 trial086 ceph-mon[98535]: pgmap v922: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 65 KiB/s rd, 85 B/s wr, 16 op/s 2026-02-18T03:53:30.728 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:30 trial155 ceph-mon[104170]: pgmap v922: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 65 KiB/s rd, 85 B/s wr, 16 op/s 2026-02-18T03:53:30.866 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.557068] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_9, nonce 10.20.193.34:0/2892908006 2026-02-18T03:53:30.866 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_9' nonce='10.20.193.34:0/2892908006' 2026-02-18T03:53:30.866 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.568910] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.866 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_dd9c9df2-d21d-4c53-98b7-07cffa1c63a6 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage28, context: None 2026-02-18T03:53:30.866 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.573420] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage28 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.573440] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode7, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ca568773-19db-420a-9e27-bf673aee5bf4 from mypool/myimage27 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.665064] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_10, nonce 10.20.193.34:0/3603176784, rc 0 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.665123] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_10, nonce 10.20.193.34:0/3603176784 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_10' nonce='10.20.193.34:0/3603176784' 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.676893] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_ca568773-19db-420a-9e27-bf673aee5bf4 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage27, context: None 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.681399] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage27 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.681418] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:30.867 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode4, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_139995c9-9f06-4423-a36f-455b987f3c73 from mypool/myimage13 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.777059] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_11, nonce 10.20.193.34:0/2499730650, rc 0 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.778085] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_11, nonce 10.20.193.34:0/2499730650 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_11' nonce='10.20.193.34:0/2499730650' 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.793072] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_139995c9-9f06-4423-a36f-455b987f3c73 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_139995c9-9f06-4423-a36f-455b987f3c73 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage13, context: None 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.799286] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage13 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.799306] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode15, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:30.868 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 from mypool/myimage57 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.121 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.897578] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_12, nonce 10.20.193.34:0/4128998477, rc 0 2026-02-18T03:53:31.121 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.898073] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_12, nonce 10.20.193.34:0/4128998477 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1263 (2): Allocated cluster name='cluster_12' nonce='10.20.193.34:0/4128998477' 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.910447] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2517 (2): Received request to add bdev_6e4002c4-f561-4f31-8509-a2fcf225df76 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage57, context: None 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.915374] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage57 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:30.915394] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode4, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:30 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:30] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 from mypool/myimage15 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.007160] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_13, nonce 10.20.193.34:0/465932475, rc 0 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.007235] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_13, nonce 10.20.193.34:0/465932475 2026-02-18T03:53:31.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_13' nonce='10.20.193.34:0/465932475' 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.019851] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_9ff6b5a3-7a4b-4fc9-831f-33bc083b60e7 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage15, context: None 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.024400] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage15 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.024419] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode15, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a994215f-b452-4dc1-ae66-b258a4b20463 from mypool/myimage59 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.120056] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_14, nonce 10.20.193.34:0/3459268990, rc 0 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.120160] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_14, nonce 10.20.193.34:0/3459268990 2026-02-18T03:53:31.123 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_14' nonce='10.20.193.34:0/3459268990' 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.131650] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_a994215f-b452-4dc1-ae66-b258a4b20463 to nqn.2016-06.io.spdk:cnode15 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage59, context: None 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.136145] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage59 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.136166] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode15, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_10262376-cdb9-4715-a5c9-e434f297f20d from mypool/myimage58 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.374 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.231713] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_15, nonce 10.20.193.34:0/1530908190, rc 0 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.231776] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_15, nonce 10.20.193.34:0/1530908190 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_15' nonce='10.20.193.34:0/1530908190' 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.245186] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_10262376-cdb9-4715-a5c9-e434f297f20d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_10262376-cdb9-4715-a5c9-e434f297f20d to nqn.2016-06.io.spdk:cnode15 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage58, context: None 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.249687] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage58 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.249707] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode4, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 from mypool/myimage16 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.349457] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_16, nonce 10.20.193.34:0/1202549902, rc 0 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.349522] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_16, nonce 10.20.193.34:0/1202549902 2026-02-18T03:53:31.375 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_16' nonce='10.20.193.34:0/1202549902' 2026-02-18T03:53:31.376 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.362073] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.376 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_0cee1a1c-e1d7-48f9-93b2-496107027741 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage16, context: None 2026-02-18T03:53:31.376 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.372344] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage16 2026-02-18T03:53:31.376 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.372365] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode7, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 from mypool/myimage26 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.466567] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_17, nonce 10.20.193.34:0/3582145328, rc 0 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.466640] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_17, nonce 10.20.193.34:0/3582145328 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_17' nonce='10.20.193.34:0/3582145328' 2026-02-18T03:53:31.674 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.478755] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_fc347f58-bf5b-4090-9d0b-54a5fea93da5 to nqn.2016-06.io.spdk:cnode7 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage26, context: None 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.483685] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage26 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.483706] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode11, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_cbdba140-e41b-4593-9c4d-8315a38586fe from mypool/myimage41 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.583550] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_18, nonce 10.20.193.34:0/872693637, rc 0 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.583624] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_18, nonce 10.20.193.34:0/872693637 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_18' nonce='10.20.193.34:0/872693637' 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.597101] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_cbdba140-e41b-4593-9c4d-8315a38586fe to nqn.2016-06.io.spdk:cnode11 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage41, context: None 2026-02-18T03:53:31.675 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.601684] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage41 2026-02-18T03:53:31.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.601705] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:31.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode4, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.676 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 from mypool/myimage14 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.938 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3447410204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:31.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.705399] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_19, nonce 10.20.193.34:0/3918625987, rc 0 2026-02-18T03:53:31.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.706076] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_19, nonce 10.20.193.34:0/3918625987 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_19' nonce='10.20.193.34:0/3918625987' 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.717441] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_285c21f3-7e21-4899-a1d7-ce38f7c01c35 to nqn.2016-06.io.spdk:cnode4 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage14, context: None 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.722238] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage14 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.722261] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode9, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 from mypool/myimage34 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.821729] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_20, nonce 10.20.193.34:0/225304641, rc 0 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.822080] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_20, nonce 10.20.193.34:0/225304641 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_20' nonce='10.20.193.34:0/225304641' 2026-02-18T03:53:31.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.832711] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_59dbff8b-a5ae-48b0-b4c5-8eb10b835db5 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage34, context: None 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.837184] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage34 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.837205] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode9, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 from mypool/myimage36 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.936844] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_21, nonce 10.20.193.34:0/3213369823, rc 0 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.936922] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_21, nonce 10.20.193.34:0/3213369823 2026-02-18T03:53:31.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:1263 (2): Allocated cluster name='cluster_21' nonce='10.20.193.34:0/3213369823' 2026-02-18T03:53:31.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:31 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3447410204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:32.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3447410204' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:32.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.950990] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:31] INFO grpc.py:2517 (2): Received request to add bdev_20efb000-c393-4437-bb67-9ffe3cf6bd56 to nqn.2016-06.io.spdk:cnode9 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage36, context: None 2026-02-18T03:53:32.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.956100] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage36 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:31 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:31.956124] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode12, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_3a9b9147-8366-460a-a1e3-8c490983994f from mypool/myimage45 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.051764] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_22, nonce 10.20.193.34:0/23422355, rc 0 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.052078] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_22, nonce 10.20.193.34:0/23422355 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_22' nonce='10.20.193.34:0/23422355' 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.063014] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_3a9b9147-8366-460a-a1e3-8c490983994f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_3a9b9147-8366-460a-a1e3-8c490983994f to nqn.2016-06.io.spdk:cnode12 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage45, context: None 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.067963] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage45 2026-02-18T03:53:32.233 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.067986] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode16, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c from mypool/myimage62 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.151839] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_23, nonce 10.20.193.34:0/2839566003, rc 0 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.151923] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_23, nonce 10.20.193.34:0/2839566003 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_23' nonce='10.20.193.34:0/2839566003' 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.163763] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_74dcb0b5-5df6-4628-b5b7-d2807a08e01c to nqn.2016-06.io.spdk:cnode16 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage62, context: None 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.168202] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage62 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.168223] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode1, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.234 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 from mypool/myimage4 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.281114] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_24, nonce 10.20.193.34:0/3851863375, rc 0 2026-02-18T03:53:32.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.281189] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_24, nonce 10.20.193.34:0/3851863375 2026-02-18T03:53:32.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_24' nonce='10.20.193.34:0/3851863375' 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.293327] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_ff6cb5fd-5476-428d-a711-ea9162efd760 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage4, context: None 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.297999] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage4 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.298022] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode6, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 from mypool/myimage21 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.389825] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_25, nonce 10.20.193.34:0/1560719496, rc 0 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.390068] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_25, nonce 10.20.193.34:0/1560719496 2026-02-18T03:53:32.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_25' nonce='10.20.193.34:0/1560719496' 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.404385] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_e2dc3c3b-a5a3-4bb4-b345-76dd7025e205 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage21, context: None 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.408957] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage21 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.408978] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode2, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 from mypool/myimage5 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.508519] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_26, nonce 10.20.193.34:0/3205396135, rc 0 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.508583] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_26, nonce 10.20.193.34:0/3205396135 2026-02-18T03:53:32.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_26' nonce='10.20.193.34:0/3205396135' 2026-02-18T03:53:32.771 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-mon[125822]: pgmap v923: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 118 KiB/s rd, 170 B/s wr, 39 op/s 2026-02-18T03:53:32.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.520504] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_5d810fab-8290-48d1-82e2-13dff94c5c59 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage5, context: None 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.525291] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage5 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.525311] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode16, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 from mypool/myimage63 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.624817] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_27, nonce 10.20.193.34:0/835830233, rc 0 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.624883] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_27, nonce 10.20.193.34:0/835830233 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_27' nonce='10.20.193.34:0/835830233' 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.636926] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_0acf5c70-329d-44fe-8cdc-4dbe5ee3f2c8 to nqn.2016-06.io.spdk:cnode16 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage63, context: None 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.641813] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage63 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.641834] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode5, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c9554767-74a0-4069-b406-c02221f52742 from mypool/myimage20 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.737534] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_28, nonce 10.20.193.34:0/618861404, rc 0 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.737599] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_28, nonce 10.20.193.34:0/618861404 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_28' nonce='10.20.193.34:0/618861404' 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.750087] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c9554767-74a0-4069-b406-c02221f52742 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_c9554767-74a0-4069-b406-c02221f52742 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage20, context: None 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.754493] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage20 2026-02-18T03:53:32.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.754512] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:32.978 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:32 trial155 ceph-mon[104170]: pgmap v923: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 118 KiB/s rd, 170 B/s wr, 39 op/s 2026-02-18T03:53:33.023 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:32 trial086 ceph-mon[98535]: pgmap v923: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 118 KiB/s rd, 170 B/s wr, 39 op/s 2026-02-18T03:53:33.081 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode10, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.081 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 from mypool/myimage40 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.081 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.853938] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_29, nonce 10.20.193.34:0/2685944582, rc 0 2026-02-18T03:53:33.081 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.853992] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_29, nonce 10.20.193.34:0/2685944582 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_29' nonce='10.20.193.34:0/2685944582' 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.866933] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_1eac5b55-335b-41db-9a9d-40a6f2dd7272 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage40, context: None 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.871456] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage40 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.871475] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode6, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_987b408b-9945-409e-aa84-a604227f1c47 from mypool/myimage22 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.971246] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_30, nonce 10.20.193.34:0/1630250133, rc 0 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.972075] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_30, nonce 10.20.193.34:0/1630250133 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:1263 (2): Allocated cluster name='cluster_30' nonce='10.20.193.34:0/1630250133' 2026-02-18T03:53:33.082 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.983888] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_987b408b-9945-409e-aa84-a604227f1c47 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:32] INFO grpc.py:2517 (2): Received request to add bdev_987b408b-9945-409e-aa84-a604227f1c47 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage22, context: None 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.988449] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage22 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:32 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:32.988471] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode14, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 from mypool/myimage53 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.080043] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_31, nonce 10.20.193.34:0/685446622, rc 0 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.080102] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_31, nonce 10.20.193.34:0/685446622 2026-02-18T03:53:33.083 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_31' nonce='10.20.193.34:0/685446622' 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.093111] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_73263ebb-2aee-481b-af4a-884585ff7eb7 to nqn.2016-06.io.spdk:cnode14 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage53, context: None 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.097837] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage53 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.097858] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode13, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19c43854-9560-498b-a7e4-7e7c9d997978 from mypool/myimage51 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.197458] bdev_rbd.c:1551:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_32, nonce 10.20.193.34:0/3388841002, rc 0 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.197523] bdev_rbd.c:1230:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_32, nonce 10.20.193.34:0/3388841002 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1263 (2): Allocated cluster name='cluster_32' nonce='10.20.193.34:0/3388841002' 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.209691] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_19c43854-9560-498b-a7e4-7e7c9d997978 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage51, context: None 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.214554] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage51 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.214575] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode11, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f from mypool/myimage42 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.307532] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_42d2ca74-e3d8-4969-ba28-c2d4ca066d0f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage42, context: None 2026-02-18T03:53:33.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.312107] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage42 2026-02-18T03:53:33.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.312132] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:33.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode11, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.384 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c from mypool/myimage43 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.411857] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_33e422a7-8bd7-4e2a-a027-ffedfe2a191c to nqn.2016-06.io.spdk:cnode11 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage43, context: None 2026-02-18T03:53:33.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.416289] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage43 2026-02-18T03:53:33.634 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.416315] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode1, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_2a00e8d6-a789-4063-8893-87b8a4379065 from mypool/myimage1 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.524015] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_2a00e8d6-a789-4063-8893-87b8a4379065 to nqn.2016-06.io.spdk:cnode1 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage1, context: None 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.528600] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage1 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.528625] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode12, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b from mypool/myimage48 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.633075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.635 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_c7e1af05-a7e7-4ed5-a87d-58f38aee923b to nqn.2016-06.io.spdk:cnode12 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage48, context: None 2026-02-18T03:53:33.924 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/665159199' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:33.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.650296] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage48 2026-02-18T03:53:33.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.650326] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode10, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 from mypool/myimage39 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.754434] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_49a72ebd-afa2-42f7-8273-d8d6df104240 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage39, context: None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.758871] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage39 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.758892] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode3, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee from mypool/myimage10 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.854105] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_9fd0f8bb-04c9-425a-88ba-3913da80c6ee to nqn.2016-06.io.spdk:cnode3 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage10, context: None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.858510] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage10 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.858531] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode13, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:33.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e from mypool/myimage50 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:33 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/665159199' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:34.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:33 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/665159199' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:34.230 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.958071] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:33] INFO grpc.py:2517 (2): Received request to add bdev_0400c6ff-2a24-4ad0-9348-069caf53a09e to nqn.2016-06.io.spdk:cnode13 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage50, context: None 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.962662] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage50 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:33.962686] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode2, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 from mypool/myimage8 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.053217] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_34235792-0a94-4590-b7f9-a7deb2a9a5c1 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage8, context: None 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.058252] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage8 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.058273] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:34.231 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode5, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 from mypool/myimage19 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.161452] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_19aac56c-957a-41f8-9b2e-740aaa9b3c16 to nqn.2016-06.io.spdk:cnode5 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage19, context: None 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.165845] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage19 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.165869] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode8, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.232 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 from mypool/myimage30 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.259968] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_13d3d8f6-3584-4dab-a948-319f26451ff8 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage30, context: None 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.264378] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage30 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.264398] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode9, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd from mypool/myimage35 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.355707] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_c50e2f53-5973-4154-8f3e-71f655fadbbd to nqn.2016-06.io.spdk:cnode9 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage35, context: None 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.360290] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage35 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.360312] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode12, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_9547d405-8c56-4722-a94a-b69a13829d7c from mypool/myimage46 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.461772] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_9547d405-8c56-4722-a94a-b69a13829d7c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_9547d405-8c56-4722-a94a-b69a13829d7c to nqn.2016-06.io.spdk:cnode12 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage46, context: None 2026-02-18T03:53:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.466204] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage46 2026-02-18T03:53:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.466225] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:34.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode13, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_0455dc91-c649-4753-958a-c8226e85f62b from mypool/myimage49 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.564203] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_0455dc91-c649-4753-958a-c8226e85f62b rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_0455dc91-c649-4753-958a-c8226e85f62b to nqn.2016-06.io.spdk:cnode13 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage49, context: None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.568547] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage49 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.568568] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode12, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_234a0907-2081-4ad3-bad2-b320ae524a99 from mypool/myimage47 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.673086] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_234a0907-2081-4ad3-bad2-b320ae524a99 to nqn.2016-06.io.spdk:cnode12 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage47, context: None 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.677528] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage47 2026-02-18T03:53:34.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.677554] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode16, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b01ce524-391b-4f53-91c0-4056a434faff from mypool/myimage61 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.780774] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b01ce524-391b-4f53-91c0-4056a434faff rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_b01ce524-391b-4f53-91c0-4056a434faff to nqn.2016-06.io.spdk:cnode16 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage61, context: None 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.785311] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage61 2026-02-18T03:53:34.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.785334] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:35.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-mon[125822]: pgmap v924: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 262 KiB/s rd, 1.5 KiB/s wr, 225 op/s 2026-02-18T03:53:35.075 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3279671956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode2, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6ef318fe-e367-43e5-bb7b-c501139b23af from mypool/myimage6 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.891516] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2517 (2): Received request to add bdev_6ef318fe-e367-43e5-bb7b-c501139b23af to nqn.2016-06.io.spdk:cnode2 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage6, context: None 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.896061] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage6 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:34.896083] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode2, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:34] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 from mypool/myimage7 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.076 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.001126] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_b89890b7-c83c-458f-ae6a-1ec858861ac4 to nqn.2016-06.io.spdk:cnode2 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage7, context: None 2026-02-18T03:53:35.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.005690] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage7 2026-02-18T03:53:35.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.005711] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:35.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode16, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.077 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d from mypool/myimage64 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:34 trial086 ceph-mon[98535]: pgmap v924: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 262 KiB/s rd, 1.5 KiB/s wr, 225 op/s 2026-02-18T03:53:35.123 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3279671956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:34 trial155 ceph-mon[104170]: pgmap v924: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 262 KiB/s rd, 1.5 KiB/s wr, 225 op/s 2026-02-18T03:53:35.228 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:34 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3279671956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:35.328 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.107793] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_d3cb162f-7015-4a86-a8ea-fbb804175c6d to nqn.2016-06.io.spdk:cnode16 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage64, context: None 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.112153] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage64 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.112174] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 2 to nqn.2016-06.io.spdk:cnode10, ana group 3, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 from mypool/myimage38 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.215168] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_8d5c1e1d-3e1b-420b-8c2b-4a203fcd1443 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 3 using ID 2, auto_visible: True, auto_resize: True, RBD image mypool/myimage38, context: None 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.219577] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage38 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.219599] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 2 2026-02-18T03:53:35.329 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode5, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.330 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_c7ad303c-247f-490c-9dac-33ec96bd548a from mypool/myimage17 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.330 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.322865] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.330 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_c7ad303c-247f-490c-9dac-33ec96bd548a to nqn.2016-06.io.spdk:cnode5 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage17, context: None 2026-02-18T03:53:35.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.331579] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage17 2026-02-18T03:53:35.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.331603] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:35.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode8, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_202a29d2-5067-450e-8584-55fb9903af3c from mypool/myimage31 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.604 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.430330] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_202a29d2-5067-450e-8584-55fb9903af3c rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_202a29d2-5067-450e-8584-55fb9903af3c to nqn.2016-06.io.spdk:cnode8 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage31, context: None 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.434714] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage31 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.434737] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode11, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_52bbe65e-5c38-4322-abef-83f43fb1199f from mypool/myimage44 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.531189] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_52bbe65e-5c38-4322-abef-83f43fb1199f to nqn.2016-06.io.spdk:cnode11 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage44, context: None 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.535803] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage44 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.535823] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode8, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.605 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 from mypool/myimage29 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.638221] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_fb6c71fc-614b-4838-ace7-6eafc6ade7f0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage29, context: None 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.642639] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage29 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.642662] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode6, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.856 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 from mypool/myimage24 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.750376] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_55cfec24-a6e2-4b57-b6fa-80ece14bd881 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage24, context: None 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.754946] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage24 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.754966] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode8, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 from mypool/myimage32 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:35.857 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.855075] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_6db1e356-4ea1-434b-bffe-0e21fd6957c0 to nqn.2016-06.io.spdk:cnode8 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage32, context: None 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.860310] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage32 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.860332] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode10, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 from mypool/myimage37 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.955010] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.128 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:35] INFO grpc.py:2517 (2): Received request to add bdev_a90c18c1-f3f0-462b-a55c-ee17332e4f12 to nqn.2016-06.io.spdk:cnode10 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage37, context: None 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.959382] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage37 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:35 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:35.959406] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode13, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 from mypool/myimage52 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.055103] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_dd2c2480-37f1-4cb2-9ddf-40a960640141 to nqn.2016-06.io.spdk:cnode13 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage52, context: None 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.059504] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage52 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.059526] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode7, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.129 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf from mypool/myimage25 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.159045] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_a9b4ddf6-560a-4bef-ba0c-1f0b47bbc1bf to nqn.2016-06.io.spdk:cnode7 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage25, context: None 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.163448] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage25 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.163470] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 4 to nqn.2016-06.io.spdk:cnode14, ana group 1, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_534446ad-3a02-4616-8b1c-973142281c1a from mypool/myimage56 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.262408] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_534446ad-3a02-4616-8b1c-973142281c1a rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.382 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_534446ad-3a02-4616-8b1c-973142281c1a to nqn.2016-06.io.spdk:cnode14 with load balancing group id 1 using ID 4, auto_visible: True, auto_resize: True, RBD image mypool/myimage56, context: None 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.266883] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage56 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.266905] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 4 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode14, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_822173ba-5087-4700-bb64-40040b45cd3e from mypool/myimage55 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.375975] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_822173ba-5087-4700-bb64-40040b45cd3e rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_822173ba-5087-4700-bb64-40040b45cd3e to nqn.2016-06.io.spdk:cnode14 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage55, context: None 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.380588] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage55 2026-02-18T03:53:36.383 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.380612] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:36.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 3 to nqn.2016-06.io.spdk:cnode6, ana group 4, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 from mypool/myimage23 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.484827] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_bd1ba77c-35f6-46fd-89ac-9f1871cebab7 to nqn.2016-06.io.spdk:cnode6 with load balancing group id 4 using ID 3, auto_visible: True, auto_resize: True, RBD image mypool/myimage23, context: None 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.489300] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage23 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.489324] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 3 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2756 (2): Received request to add namespace 1 to nqn.2016-06.io.spdk:cnode3, ana group 2, no_auto_visible: False, disable_auto_resize: False, read_only: False, location: "", encryption_entries: [], encryption_algorithm: no_algorithm, context: None 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:1492 (2): Received request to create read write bdev bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 from mypool/myimage9 (size 0 bytes) with block size 512, will not create image if doesn't exist, context=None 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.596079] bdev_rbd.c:1757:bdev_rbd_create: *NOTICE*: Add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 rbd disk to lun , cluster-id 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:2517 (2): Received request to add bdev_861c65c6-8f74-4c46-b16f-afcec6d7d188 to nqn.2016-06.io.spdk:cnode3 with load balancing group id 2 using ID 1, auto_visible: True, auto_resize: True, RBD image mypool/myimage9, context: None 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.600595] bdev_rbd.c:1935:bdev_rbd_ns_reservation_load_json: *NOTICE*: Failed to get metadata key = reservation_key rbd-name myimage9 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.600618] subsystem_rbd_resrv.c: 160:ns_rdb_load: *NOTICE*: Subsystem load reservation failed, rc -2, ns 1 2026-02-18T03:53:36.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.669 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:36.668454] tcp.c:1165:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.20.193.34 port 4420 *** 2026-02-18T03:53:36.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.923 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode15 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.924 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.925 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode10 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.926 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode7 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.927 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode13 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode6 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode8 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode16 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode11 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial086 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.86:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial086 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode4 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode5 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode12 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial177 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 10.20.193.177:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial177 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode9 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial034 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode14 at 10.20.193.34:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6183 (2): Received request to create trial155 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 10.20.193.155:4420, secure: False, verify host name: True, context: None 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO grpc.py:6252 (2): Listener not created as gateway's host name trial034 differs from requested host trial155 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO state.py:2068 (2): Update complete (1 -> 161) (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:53:36.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:36] INFO state.py:2073 (2): Initialization is over (gateway-client.nvmeof.nvmeof.a). 2026-02-18T03:53:37.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:36 trial034 ceph-mon[125822]: pgmap v925: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 557 KiB/s rd, 3.5 KiB/s wr, 513 op/s 2026-02-18T03:53:37.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:36 trial086 ceph-mon[98535]: pgmap v925: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 557 KiB/s rd, 3.5 KiB/s wr, 513 op/s 2026-02-18T03:53:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:36 trial155 ceph-mon[104170]: pgmap v925: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 557 KiB/s rd, 3.5 KiB/s wr, 513 op/s 2026-02-18T03:53:38.270 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/1324487496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:38.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/1324487496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:38.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:53:38] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:53:38.374 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.375 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:53:38.376 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.377 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:53:38.378 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.379 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:53:38.380 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:53:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:53:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:53:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:53:38.381 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49434 2026-02-18T03:53:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:38 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/1324487496' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:39 trial034 ceph-mon[125822]: pgmap v926: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 572 KiB/s rd, 3.8 KiB/s wr, 561 op/s 2026-02-18T03:53:39.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:39 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1448008838' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:39 trial086 ceph-mon[98535]: pgmap v926: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 572 KiB/s rd, 3.8 KiB/s wr, 561 op/s 2026-02-18T03:53:39.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:39 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1448008838' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:39 trial155 ceph-mon[104170]: pgmap v926: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 572 KiB/s rd, 3.8 KiB/s wr, 561 op/s 2026-02-18T03:53:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:39 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1448008838' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:41 trial086 ceph-mon[98535]: pgmap v927: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 752 KiB/s rd, 5.2 KiB/s wr, 760 op/s 2026-02-18T03:53:41.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1926053165' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:41 trial155 ceph-mon[104170]: pgmap v927: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 752 KiB/s rd, 5.2 KiB/s wr, 760 op/s 2026-02-18T03:53:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1926053165' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-mon[125822]: pgmap v927: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 752 KiB/s rd, 5.2 KiB/s wr, 760 op/s 2026-02-18T03:53:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1926053165' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:53:41] INFO grpc.py:2631 (2): Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2026-02-18T03:53:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode10" 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode11" 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode12" 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode13" 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode14" 2026-02-18T03:53:41.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode15" 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode16" 2026-02-18T03:53:41.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2026-02-18T03:53:41.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode4" 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode5" 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode6" 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.527 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode7" 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode8" 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: states { 2026-02-18T03:53:41.528 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: grp_id: 1 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: state: OPTIMIZED 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: } 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: ], , client address: IPv4 10.20.193.34:42818 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.076592] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_24 elapsed time: 0.000174 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.092500] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000128 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.108522] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_22 elapsed time: 0.000164 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.124482] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000123 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.140493] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000138 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.164502] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000147 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.180489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000136 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.196490] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000138 seconds 2026-02-18T03:53:41.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.212475] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000123 seconds 2026-02-18T03:53:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.228464] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000113 seconds 2026-02-18T03:53:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.244488] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000130 seconds 2026-02-18T03:53:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.268489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000139 seconds 2026-02-18T03:53:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.284487] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000138 seconds 2026-02-18T03:53:41.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.300503] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000150 seconds 2026-02-18T03:53:42.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2395404081' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2395404081' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2395404081' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:43.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:43 trial086 ceph-mon[98535]: pgmap v928: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 793 KiB/s rd, 5.2 KiB/s wr, 767 op/s 2026-02-18T03:53:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:43 trial155 ceph-mon[104170]: pgmap v928: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 793 KiB/s rd, 5.2 KiB/s wr, 767 op/s 2026-02-18T03:53:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:43 trial034 ceph-mon[125822]: pgmap v928: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 793 KiB/s rd, 5.2 KiB/s wr, 767 op/s 2026-02-18T03:53:44.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:53:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:43.719299] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:53:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:45 trial086 ceph-mon[98535]: pgmap v929: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 740 KiB/s rd, 5.2 KiB/s wr, 744 op/s 2026-02-18T03:53:45.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2654929659' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:45 trial155 ceph-mon[104170]: pgmap v929: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 740 KiB/s rd, 5.2 KiB/s wr, 744 op/s 2026-02-18T03:53:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:45 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2654929659' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:45 trial034 ceph-mon[125822]: pgmap v929: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 740 KiB/s rd, 5.2 KiB/s wr, 744 op/s 2026-02-18T03:53:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:45 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2654929659' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:46.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:46 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1193598351' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:46.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:46 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1193598351' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:46.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:46 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1193598351' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:47.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:47 trial086 ceph-mon[98535]: pgmap v930: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 826 KiB/s rd, 5.1 KiB/s wr, 570 op/s 2026-02-18T03:53:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:47 trial155 ceph-mon[104170]: pgmap v930: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 826 KiB/s rd, 5.1 KiB/s wr, 570 op/s 2026-02-18T03:53:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:47 trial034 ceph-mon[125822]: pgmap v930: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 826 KiB/s rd, 5.1 KiB/s wr, 570 op/s 2026-02-18T03:53:48.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2996007643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:48 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2996007643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:48.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:48 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2996007643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:49 trial086 ceph-mon[98535]: pgmap v931: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 618 KiB/s rd, 3.4 KiB/s wr, 287 op/s 2026-02-18T03:53:49.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2616406538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:49 trial155 ceph-mon[104170]: pgmap v931: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 618 KiB/s rd, 3.4 KiB/s wr, 287 op/s 2026-02-18T03:53:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:49 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2616406538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:49 trial034 ceph-mon[125822]: pgmap v931: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 618 KiB/s rd, 3.4 KiB/s wr, 287 op/s 2026-02-18T03:53:49.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:49 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2616406538' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:51.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:51 trial086 ceph-mon[98535]: pgmap v932: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 965 KiB/s rd, 4.2 KiB/s wr, 253 op/s 2026-02-18T03:53:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:51 trial155 ceph-mon[104170]: pgmap v932: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 965 KiB/s rd, 4.2 KiB/s wr, 253 op/s 2026-02-18T03:53:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:51 trial034 ceph-mon[125822]: pgmap v932: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 965 KiB/s rd, 4.2 KiB/s wr, 253 op/s 2026-02-18T03:53:52.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3775773505' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3775773505' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:52.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3775773505' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:53 trial086 ceph-mon[98535]: pgmap v933: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 822 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2026-02-18T03:53:53.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:53 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3527702441' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:53 trial155 ceph-mon[104170]: pgmap v933: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 822 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2026-02-18T03:53:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:53 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3527702441' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:53 trial034 ceph-mon[125822]: pgmap v933: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 822 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2026-02-18T03:53:53.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:53 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3527702441' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:55 trial086 ceph-mon[98535]: pgmap v934: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 773 KiB/s rd, 2.7 KiB/s wr, 41 op/s 2026-02-18T03:53:55.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/720413643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:55 trial155 ceph-mon[104170]: pgmap v934: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 773 KiB/s rd, 2.7 KiB/s wr, 41 op/s 2026-02-18T03:53:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:55 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/720413643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:55.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:55 trial034 ceph-mon[125822]: pgmap v934: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 773 KiB/s rd, 2.7 KiB/s wr, 41 op/s 2026-02-18T03:53:55.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:55 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/720413643' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2421679848' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:56 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2421679848' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:56.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:56 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2421679848' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:57.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:57 trial086 ceph-mon[98535]: pgmap v935: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 810 KiB/s rd, 2.7 KiB/s wr, 45 op/s 2026-02-18T03:53:57.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:57 trial155 ceph-mon[104170]: pgmap v935: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 810 KiB/s rd, 2.7 KiB/s wr, 45 op/s 2026-02-18T03:53:57.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:57 trial034 ceph-mon[125822]: pgmap v935: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 810 KiB/s rd, 2.7 KiB/s wr, 45 op/s 2026-02-18T03:53:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:59 trial086 ceph-mon[98535]: pgmap v936: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 552 KiB/s rd, 1.4 KiB/s wr, 29 op/s 2026-02-18T03:53:59.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:53:59 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/2425741656' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:59 trial155 ceph-mon[104170]: pgmap v936: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 552 KiB/s rd, 1.4 KiB/s wr, 29 op/s 2026-02-18T03:53:59.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:53:59 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/2425741656' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:53:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:59 trial034 ceph-mon[125822]: pgmap v936: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 552 KiB/s rd, 1.4 KiB/s wr, 29 op/s 2026-02-18T03:53:59.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:53:59 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/2425741656' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:00.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:00 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1257633366' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:00.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:00 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1257633366' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:00.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:00 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1257633366' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:01.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:01 trial086 ceph-mon[98535]: pgmap v937: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 465 KiB/s rd, 1.1 KiB/s wr, 25 op/s 2026-02-18T03:54:01.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:01 trial155 ceph-mon[104170]: pgmap v937: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 465 KiB/s rd, 1.1 KiB/s wr, 25 op/s 2026-02-18T03:54:01.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:01 trial034 ceph-mon[125822]: pgmap v937: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 465 KiB/s rd, 1.1 KiB/s wr, 25 op/s 2026-02-18T03:54:02.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:02 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1935620432' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:02.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:02 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1935620432' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:02.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:02 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1935620432' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:03 trial086 ceph-mon[98535]: pgmap v938: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:03.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:03 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3449246699' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:03.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:03 trial155 ceph-mon[104170]: pgmap v938: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:03.379 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:03 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3449246699' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:03 trial034 ceph-mon[125822]: pgmap v938: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:03.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:03 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3449246699' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:05.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:05 trial086 ceph-mon[98535]: pgmap v939: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:05.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:05 trial155 ceph-mon[104170]: pgmap v939: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:05.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:05 trial034 ceph-mon[125822]: pgmap v939: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:06.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:06 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3055737915' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:06.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:06 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3055737915' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:06.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:06 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3055737915' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:07 trial086 ceph-mon[98535]: pgmap v940: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:07.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:07 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/706147561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:07 trial155 ceph-mon[104170]: pgmap v940: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:07.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:07 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/706147561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:07 trial034 ceph-mon[125822]: pgmap v940: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:07.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:07 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/706147561' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:09 trial086 ceph-mon[98535]: pgmap v941: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:09.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:09 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1463267125' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:09 trial155 ceph-mon[104170]: pgmap v941: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:09.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:09 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1463267125' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:09 trial034 ceph-mon[125822]: pgmap v941: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:09.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:09 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1463267125' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:10.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:10 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/2416299778' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:10.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:10 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/2416299778' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:10.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:10 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/2416299778' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:11.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:11 trial086 ceph-mon[98535]: pgmap v942: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:11.422 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:11 trial034 ceph-mon[125822]: pgmap v942: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:11.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:11 trial155 ceph-mon[104170]: pgmap v942: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:13 trial086 ceph-mon[98535]: pgmap v943: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:13.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:13 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3081352773' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:13 trial155 ceph-mon[104170]: pgmap v943: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:13.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:13 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3081352773' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:13 trial034 ceph-mon[125822]: pgmap v943: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:13.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:13 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3081352773' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:14.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:14 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2502175709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:14.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:14 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2502175709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:14.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:14 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2502175709' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:15.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:15 trial086 ceph-mon[98535]: pgmap v944: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:15.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:15 trial155 ceph-mon[104170]: pgmap v944: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:15.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:15 trial034 ceph-mon[125822]: pgmap v944: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:16.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:16 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/3772890307' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:16.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:16 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/3772890307' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:16.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:16 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/3772890307' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:17 trial086 ceph-mon[98535]: pgmap v945: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:17.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:17 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3464041292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:17 trial155 ceph-mon[104170]: pgmap v945: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:17.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:17 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3464041292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:17 trial034 ceph-mon[125822]: pgmap v945: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:17.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:17 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3464041292' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:19.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:19 trial086 ceph-mon[98535]: pgmap v946: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:19.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:19 trial155 ceph-mon[104170]: pgmap v946: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:19.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:19 trial034 ceph-mon[125822]: pgmap v946: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:20.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:20 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3281283097' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:20.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:20 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3281283097' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:20.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:20 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3281283097' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:21 trial155 ceph-mon[104170]: pgmap v947: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:21.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:21 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3779223914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:21 trial034 ceph-mon[125822]: pgmap v947: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:21.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:21 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3779223914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:21 trial086 ceph-mon[98535]: pgmap v947: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:21.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:21 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3779223914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:23 trial155 ceph-mon[104170]: pgmap v948: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:23.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:23 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2828897278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:23 trial034 ceph-mon[125822]: pgmap v948: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:23.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:23 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2828897278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:23 trial086 ceph-mon[98535]: pgmap v948: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:23.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:23 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2828897278' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:24.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:24 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/569745571' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:24.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:24 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/569745571' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:24.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:24 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/569745571' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:25.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:25 trial155 ceph-mon[104170]: pgmap v949: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:25.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:25 trial034 ceph-mon[125822]: pgmap v949: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:25.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:25 trial086 ceph-mon[98535]: pgmap v949: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:27 trial155 ceph-mon[104170]: pgmap v950: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:27.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:27 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/803929410' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:27 trial034 ceph-mon[125822]: pgmap v950: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:27.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:27 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/803929410' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:27 trial086 ceph-mon[98535]: pgmap v950: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:27.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:27 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/803929410' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:28.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:54:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:54:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:54:28.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:28 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/3406460047' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:54:28.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:28 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/3406460047' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:28.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-18T03:54:28.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-18T03:54:28.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:28.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-18T03:54:28.624 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:28 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/3406460047' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:29.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:29 trial155 ceph-mon[104170]: pgmap v951: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:29.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:29 trial034 ceph-mon[125822]: pgmap v951: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:29.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:29 trial086 ceph-mon[98535]: pgmap v951: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:30.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:30 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/689983783' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:30.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:30 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/689983783' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:30.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:30 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/689983783' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:31 trial155 ceph-mon[104170]: pgmap v952: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:31.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:31 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/72984257' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:31 trial034 ceph-mon[125822]: pgmap v952: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:31.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:31 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/72984257' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:31.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:31 trial086 ceph-mon[98535]: pgmap v952: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:31.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:31 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/72984257' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:33.425 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:33 trial086 ceph-mon[98535]: pgmap v953: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:33.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:33 trial155 ceph-mon[104170]: pgmap v953: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:33.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:33 trial034 ceph-mon[125822]: pgmap v953: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:34.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:34 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3860442603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:34.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:34 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3860442603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:34.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:34 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3860442603' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:35 trial155 ceph-mon[104170]: pgmap v954: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:35.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:35 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/1911751835' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:35.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:35 trial034 ceph-mon[125822]: pgmap v954: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:35.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:35 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/1911751835' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:35 trial086 ceph-mon[98535]: pgmap v954: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:35.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:35 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/1911751835' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:37 trial155 ceph-mon[104170]: pgmap v955: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:37.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:37 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/2784656251' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:37.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:37 trial034 ceph-mon[125822]: pgmap v955: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:37.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:37 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/2784656251' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:37.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:37 trial086 ceph-mon[98535]: pgmap v955: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:37.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:37 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/2784656251' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:38.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:38 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3139731956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:38.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:38 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3139731956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:38.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:38 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3139731956' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:39.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:39 trial155 ceph-mon[104170]: pgmap v956: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:39.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:39 trial034 ceph-mon[125822]: pgmap v956: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:39.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:39 trial086 ceph-mon[98535]: pgmap v956: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:41 trial155 ceph-mon[104170]: pgmap v957: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:41.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:41 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/4154924138' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:41.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:41 trial034 ceph-mon[125822]: pgmap v957: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:41.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:41 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/4154924138' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:41.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:41 trial086 ceph-mon[98535]: pgmap v957: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:41.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:41 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/4154924138' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:42.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:42 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/551232630' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:42.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:42 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/551232630' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:42.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:42 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/551232630' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:43.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:43 trial155 ceph-mon[104170]: pgmap v958: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:43.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:43 trial034 ceph-mon[125822]: pgmap v958: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:43.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:43 trial086 ceph-mon[98535]: pgmap v958: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:44.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:44 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1370100437' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:44.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:44 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1370100437' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:44.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:44 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1370100437' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:45 trial155 ceph-mon[104170]: pgmap v959: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:45.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:45 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/678087515' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:45.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:45 trial034 ceph-mon[125822]: pgmap v959: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:45.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:45 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/678087515' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:45.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:45 trial086 ceph-mon[98535]: pgmap v959: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:45.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:45 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/678087515' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:47.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:47 trial155 ceph-mon[104170]: pgmap v960: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:47.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:47 trial034 ceph-mon[125822]: pgmap v960: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:47.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:47 trial086 ceph-mon[98535]: pgmap v960: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:48.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:48 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/3512392977' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:48.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:48 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/3512392977' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:48.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:48 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/3512392977' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:49 trial155 ceph-mon[104170]: pgmap v961: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:49.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:49 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/635276914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:49.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:49 trial034 ceph-mon[125822]: pgmap v961: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:49.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:49 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/635276914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:49.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:49 trial086 ceph-mon[98535]: pgmap v961: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:49.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:49 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/635276914' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:50.214 INFO:tasks.nvmeof.[nvmeof.thrasher]:done waiting before thrashing - everything should be up now 2026-02-18T03:54:50.214 INFO:tasks.nvmeof.[nvmeof.thrasher]:display and verify stats: 2026-02-18T03:54:50.215 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a 2026-02-18T03:54:50.247 INFO:teuthology.orchestra.run.trial034.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service - Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:54:50.248 INFO:teuthology.orchestra.run.trial034.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:54:50.248 INFO:teuthology.orchestra.run.trial034.stdout: Active: active (running) since Wed 2026-02-18 03:53:26 UTC; 1min 23s ago 2026-02-18T03:54:50.248 INFO:teuthology.orchestra.run.trial034.stdout: Process: 127615 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.248 INFO:teuthology.orchestra.run.trial034.stdout: Process: 127616 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.a/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.248 INFO:teuthology.orchestra.run.trial034.stdout: Main PID: 127699 (conmon) 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: Memory: 324.0M (peak: 326.4M) 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: CPU: 5min 28.280s 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: ├─libpod-payload-13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─127701 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.249 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─127703 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─127827 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.a --gateway-address 10.20.193.34:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.34:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.a -k /etc/ceph/keyring 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: │ ├─128110 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: │ └─128115 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: └─runtime 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: └─127699 /usr/bin/conmon --api-version 1 -c 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce -u 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce/userdata -p /run/containers/storage/overlay-containers/13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce 2026-02-18T03:54:50.250 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.164502] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000147 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.180489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000136 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.196490] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_8 elapsed time: 0.000138 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.212475] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_7 elapsed time: 0.000123 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.228464] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000113 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.244488] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_28 elapsed time: 0.000130 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.268489] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_9 elapsed time: 0.000139 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.284487] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_25 elapsed time: 0.000138 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:41 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:41.300503] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_21 elapsed time: 0.000150 seconds 2026-02-18T03:54:50.251 INFO:teuthology.orchestra.run.trial034.stdout:Feb 18 03:53:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:53:43.719299] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:54:50.253 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b 2026-02-18T03:54:50.281 INFO:teuthology.orchestra.run.trial086.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service - Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:54:50.281 INFO:teuthology.orchestra.run.trial086.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Active: active (running) since Wed 2026-02-18 03:39:52 UTC; 14min ago 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98728 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Process: 98729 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.b/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Main PID: 98808 (conmon) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: Memory: 359.5M (peak: 363.9M) 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: CPU: 59min 34.045s 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service 2026-02-18T03:54:50.282 INFO:teuthology.orchestra.run.trial086.stdout: ├─libpod-payload-8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98810 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98815 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─98832 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.b --gateway-address 10.20.193.86:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.86:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.b -k /etc/ceph/keyring 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: │ ├─99206 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: │ └─99214 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: └─runtime 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: └─98808 /usr/bin/conmon --api-version 1 -c 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -u 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata -p /run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-18T03:54:50.283 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: , nqn: "nqn.2016-06.io.spdk:cnode9" 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: states { 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: grp_id: 1 2026-02-18T03:54:50.285 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: state: INACCESSIBLE 2026-02-18T03:54:50.286 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: } 2026-02-18T03:54:50.286 INFO:teuthology.orchestra.run.trial086.stdout:Feb 18 03:53:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ], , client address: IPv4 10.20.193.86:49434 2026-02-18T03:54:50.286 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c 2026-02-18T03:54:50.314 INFO:teuthology.orchestra.run.trial155.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service - Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:54:50.314 INFO:teuthology.orchestra.run.trial155.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:54:50.314 INFO:teuthology.orchestra.run.trial155.stdout: Active: active (running) since Wed 2026-02-18 03:51:17 UTC; 3min 32s ago 2026-02-18T03:54:50.314 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105760 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.314 INFO:teuthology.orchestra.run.trial155.stdout: Process: 105761 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.c/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: Main PID: 105840 (conmon) 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: Tasks: 596 (limit: 814972) 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: Memory: 337.2M (peak: 338.8M) 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: CPU: 13min 51.167s 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: ├─libpod-payload-62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105842 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105844 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─105968 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.c --gateway-address 10.20.193.155:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.155:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.c -k /etc/ceph/keyring 2026-02-18T03:54:50.315 INFO:teuthology.orchestra.run.trial155.stdout: │ ├─106252 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:54:50.316 INFO:teuthology.orchestra.run.trial155.stdout: │ └─106257 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.316 INFO:teuthology.orchestra.run.trial155.stdout: └─runtime 2026-02-18T03:54:50.316 INFO:teuthology.orchestra.run.trial155.stdout: └─105840 /usr/bin/conmon --api-version 1 -c 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -u 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata -p /run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 2026-02-18T03:54:50.316 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.621148] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_15 elapsed time: 0.000131 seconds 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.637194] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_18 elapsed time: 0.000155 seconds 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.661170] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_3 elapsed time: 0.000146 seconds 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.704254] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_11 elapsed time: 0.000144 seconds 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.720267] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_32 elapsed time: 0.000145 seconds 2026-02-18T03:54:50.317 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.736252] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000144 seconds 2026-02-18T03:54:50.318 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.752257] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_29 elapsed time: 0.000144 seconds 2026-02-18T03:54:50.318 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.768271] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_17 elapsed time: 0.000157 seconds 2026-02-18T03:54:50.318 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.792262] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_27 elapsed time: 0.000137 seconds 2026-02-18T03:54:50.318 INFO:teuthology.orchestra.run.trial155.stdout:Feb 18 03:51:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:51:41.808259] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000144 seconds 2026-02-18T03:54:50.318 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl status ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout:● ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service - Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Loaded: loaded (/etc/systemd/system/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@.service; enabled; preset: disabled) 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Active: active (running) since Wed 2026-02-18 03:42:43 UTC; 12min ago 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74963 ExecStartPre=/bin/rm -f /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-cid (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Process: 74964 ExecStart=/bin/bash /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/nvmeof.nvmeof.d/unit.run (code=exited, status=0/SUCCESS) 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Main PID: 75043 (conmon) 2026-02-18T03:54:50.357 INFO:teuthology.orchestra.run.trial177.stdout: Tasks: 595 (limit: 814972) 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: Memory: 378.6M (peak: 381.6M) 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: CPU: 49min 22.826s 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: CGroup: /system.slice/system-ceph\x2d3ff67590\x2d0c79\x2d11f1\x2d9051\x2dd404e6e7d460.slice/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: ├─libpod-payload-06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75045 /run/podman-init -- python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75047 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75182 /usr/bin/ceph-nvmeof-monitor-client --gateway-name client.nvmeof.nvmeof.d --gateway-address 10.20.193.177:5500 --gateway-pool mypool --gateway-group mygroup0 --monitor-group-address 10.20.193.177:5499 -c /etc/ceph/ceph.conf -n client.nvmeof.nvmeof.d -k /etc/ceph/keyring 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: │ ├─75300 /usr/local/bin/nvmf_tgt --wait-for-rpc -u -r /var/tmp/spdk.sock --lcores "(0-3)" 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: │ └─75305 python3 -m control -c /src/ceph-nvmeof.conf 2026-02-18T03:54:50.358 INFO:teuthology.orchestra.run.trial177.stdout: └─runtime 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout: └─75043 /usr/bin/conmon --api-version 1 -c 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -u 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata -p /run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/pidfile -n ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d --exit-dir /run/libpod/exits --persist-dir /run/libpod/persist/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 --full-attach -l journald --log-level warning --syslog --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9/userdata/oci-log --conmon-pidfile /run/ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service-pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --db-backend --exit-command-arg sqlite --exit-command-arg --transient-store=false --exit-command-arg --hooks-dir --exit-command-arg /usr/share/containers/oci/hooks.d --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev,metacopy=on --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --stopped-only --exit-command-arg --rm --exit-command-arg 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.114784] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_31 elapsed time: 0.000149 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.130800] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_13 elapsed time: 0.000166 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.146798] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_10 elapsed time: 0.000165 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.162904] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_16 elapsed time: 0.000266 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.186803] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_4 elapsed time: 0.000162 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:42:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:42:57.202787] bdev_rbd.c:1302:_bdev_rbd_wait_for_latest_osdmap: *NOTICE*: rados_wait_for_latest_osdmap cluster: cluster_5 elapsed time: 0.000152 seconds 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:43:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:43:01.673349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'host_keepalive_timeout' already registered. 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:54:50.359 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T03:54:50.360 INFO:teuthology.orchestra.run.trial177.stdout:Feb 18 03:46:45 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:46:45] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:54:50.361 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ls 2026-02-18T03:54:50.583 INFO:teuthology.orchestra.run.trial177.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-18T03:54:50.583 INFO:teuthology.orchestra.run.trial177.stdout:mgr 1/1 83s ago 29m trial034=x;count:1 2026-02-18T03:54:50.583 INFO:teuthology.orchestra.run.trial177.stdout:mon 3/3 4m ago 30m trial034:10.20.193.34=a;trial086:10.20.193.86=b;trial155:10.20.193.155=c;count:3 2026-02-18T03:54:50.584 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.mypool.mygroup0 ?:4420,5500,8009,10008 4/4 4m ago 28m trial034=nvmeof.a;trial086=nvmeof.b;trial155=nvmeof.c;trial177=nvmeof.d 2026-02-18T03:54:50.584 INFO:teuthology.orchestra.run.trial177.stdout:osd.default 8 4m ago 28m trial155 2026-02-18T03:54:50.591 DEBUG:teuthology.orchestra.run.trial177:> ceph orch ps --daemon-type nvmeof 2026-02-18T03:54:50.771 INFO:teuthology.orchestra.run.trial177.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-18T03:54:50.771 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.a trial034 *:5500,4420,8009,10008 running (84s) 83s ago 18m 53.5M - 1.6.5 99a57256b38c 13d5247ab1c8 2026-02-18T03:54:50.771 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.b trial086 *:5500,4420,8009,10008 running (14m) 4m ago 18m 371M - 1.6.5 99a57256b38c 8ebc37f377b2 2026-02-18T03:54:50.771 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.c trial155 *:5500,4420,8009,10008 running (3m) 3m ago 10m 54.7M - 1.6.5 99a57256b38c 62d2283ebd8a 2026-02-18T03:54:50.771 INFO:teuthology.orchestra.run.trial177.stdout:nvmeof.nvmeof.d trial177 *:5500,4420,8009,10008 running (12m) 86s ago 18m 392M - 1.6.5 99a57256b38c 06e0fcc1e8ce 2026-02-18T03:54:50.779 DEBUG:teuthology.orchestra.run.trial177:> ceph health detail 2026-02-18T03:54:51.003 INFO:teuthology.orchestra.run.trial177.stdout:HEALTH_OK 2026-02-18T03:54:51.012 DEBUG:teuthology.orchestra.run.trial177:> ceph -s 2026-02-18T03:54:51.229 INFO:teuthology.orchestra.run.trial177.stdout: cluster: 2026-02-18T03:54:51.229 INFO:teuthology.orchestra.run.trial177.stdout: id: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: health: HEALTH_OK 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: services: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: mon: 3 daemons, quorum a,c,b (age 3m) [leader: a] 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: mgr: x(active, since 30m) 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: osd: 8 osds: 8 up (since 28m), 8 in (since 28m) 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: nvmeof: 4 gateways active (4 hosts) 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: data: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: pools: 2 pools, 33 pgs 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: objects: 4.29k objects, 16 GiB 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: usage: 56 GiB used, 5.4 TiB / 5.5 TiB avail 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: pgs: 33 active+clean 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: io: 2026-02-18T03:54:51.230 INFO:teuthology.orchestra.run.trial177.stdout: client: 75 KiB/s rd, 0 B/s wr, 5 op/s rd, 2 op/s wr 2026-02-18T03:54:51.231 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-18T03:54:51.237 DEBUG:teuthology.orchestra.run.trial177:> ceph nvme-gw show mypool mygroup0 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "epoch": 248, 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "pool": "mypool", 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "group": "mygroup0", 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "features": "LB", 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "rebalance_ana_group": 3, 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "num gws": 4, 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "GW-epoch": 194, 2026-02-18T03:54:51.469 INFO:teuthology.orchestra.run.trial177.stdout: "Anagrp list": "[ 1 2 3 4 ]", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 64, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "Created Gateways:": [ 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.a", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 1, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: ACTIVE , 2: STANDBY , 3: STANDBY , 4: STANDBY " 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.b", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 2, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: ACTIVE , 3: STANDBY , 4: STANDBY " 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.c", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 3, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: ACTIVE , 4: STANDBY " 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: }, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: { 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "gw-id": "client.nvmeof.nvmeof.d", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "anagrp-id": 4, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-namespaces": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "performed-full-startup": 1, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "Availability": "AVAILABLE", 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "num-listeners": 16, 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: "ana states": " 1: STANDBY , 2: STANDBY , 3: STANDBY , 4: ACTIVE " 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: } 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-18T03:54:51.470 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-18T03:54:51.478 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list 2026-02-18T03:54:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:51 trial155 ceph-mon[104170]: pgmap v962: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:51 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1201572717' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:51.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:51 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1048673535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:54:51.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:51 trial034 ceph-mon[125822]: pgmap v962: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:51 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1201572717' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:51.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:51 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1048673535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:Node Generic SN Model Namespace Usage Format FW Rev 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme0n1 /dev/ng0n1 25174FCD65D8 Micron_7450_MTFDKBA960TFR 0x1 57.09 GB / 960.20 GB 512 B + 0 B E2MU200 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n1 /dev/ng12n1 Ceph75694736504890 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n2 /dev/ng12n2 Ceph75694736504890 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n3 /dev/ng12n3 Ceph75694736504890 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.549 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme12n4 /dev/ng12n4 Ceph75694736504890 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n1 /dev/ng16n1 Ceph51496246911324 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n2 /dev/ng16n2 Ceph51496246911324 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n3 /dev/ng16n3 Ceph51496246911324 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme16n4 /dev/ng16n4 Ceph51496246911324 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme1n1 /dev/ng1n1 012510B47B1C MTFDKCC1T9TGP-1BK1JABYY 0x1 71.01 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n1 /dev/ng20n1 Ceph65615196794868 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n2 /dev/ng20n2 Ceph65615196794868 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n3 /dev/ng20n3 Ceph65615196794868 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme20n4 /dev/ng20n4 Ceph65615196794868 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n1 /dev/ng24n1 Ceph33754540835311 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.550 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n2 /dev/ng24n2 Ceph33754540835311 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n3 /dev/ng24n3 Ceph33754540835311 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme24n4 /dev/ng24n4 Ceph33754540835311 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n1 /dev/ng28n1 Ceph66503271982671 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n2 /dev/ng28n2 Ceph66503271982671 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n3 /dev/ng28n3 Ceph66503271982671 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme28n4 /dev/ng28n4 Ceph66503271982671 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme2n1 /dev/ng2n1 012510B00421 MTFDKCC1T9TGP-1BK1JABYY 0x1 166.68 GB / 1.92 TB 512 B + 0 B E3MQ000 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n1 /dev/ng32n1 Ceph14926682106859 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n2 /dev/ng32n2 Ceph14926682106859 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n3 /dev/ng32n3 Ceph14926682106859 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme32n4 /dev/ng32n4 Ceph14926682106859 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n1 /dev/ng36n1 Ceph91399272374620 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.551 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n2 /dev/ng36n2 Ceph91399272374620 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n3 /dev/ng36n3 Ceph91399272374620 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme36n4 /dev/ng36n4 Ceph91399272374620 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n1 /dev/ng40n1 Ceph61801836239121 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n2 /dev/ng40n2 Ceph61801836239121 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n3 /dev/ng40n3 Ceph61801836239121 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme40n4 /dev/ng40n4 Ceph61801836239121 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n1 /dev/ng44n1 Ceph56247354555456 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n2 /dev/ng44n2 Ceph56247354555456 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n3 /dev/ng44n3 Ceph56247354555456 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme44n4 /dev/ng44n4 Ceph56247354555456 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n1 /dev/ng48n1 Ceph40845607382583 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.552 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n2 /dev/ng48n2 Ceph40845607382583 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n3 /dev/ng48n3 Ceph40845607382583 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme48n4 /dev/ng48n4 Ceph40845607382583 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n1 /dev/ng4n1 Ceph55936123663244 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n2 /dev/ng4n2 Ceph55936123663244 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n3 /dev/ng4n3 Ceph55936123663244 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme4n4 /dev/ng4n4 Ceph55936123663244 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n1 /dev/ng52n1 Ceph50531101135613 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n2 /dev/ng52n2 Ceph50531101135613 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n3 /dev/ng52n3 Ceph50531101135613 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme52n4 /dev/ng52n4 Ceph50531101135613 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n1 /dev/ng56n1 Ceph68079984791060 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.553 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n2 /dev/ng56n2 Ceph68079984791060 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n3 /dev/ng56n3 Ceph68079984791060 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme56n4 /dev/ng56n4 Ceph68079984791060 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n1 /dev/ng60n1 Ceph54002212482360 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n2 /dev/ng60n2 Ceph54002212482360 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n3 /dev/ng60n3 Ceph54002212482360 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme60n4 /dev/ng60n4 Ceph54002212482360 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n1 /dev/ng64n1 Ceph48985563661949 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n2 /dev/ng64n2 Ceph48985563661949 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n3 /dev/ng64n3 Ceph48985563661949 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme64n4 /dev/ng64n4 Ceph48985563661949 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n1 /dev/ng8n1 Ceph70783795201823 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n2 /dev/ng8n2 Ceph70783795201823 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.554 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n3 /dev/ng8n3 Ceph70783795201823 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.555 INFO:teuthology.orchestra.run.trial014.stdout:/dev/nvme8n4 /dev/ng8n4 Ceph70783795201823 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 25.09 2026-02-18T03:54:51.556 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n1 | grep 'live optimized' 2026-02-18T03:54:51.603 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme9 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.604 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n1 | grep 'live optimized' 2026-02-18T03:54:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:51 trial086 ceph-mon[98535]: pgmap v962: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1201572717' entity='client.nvmeof.nvmeof.d' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:51.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:51 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1048673535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2026-02-18T03:54:51.648 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme13 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.649 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n1 | grep 'live optimized' 2026-02-18T03:54:51.693 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme17 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.694 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n1 | grep 'live optimized' 2026-02-18T03:54:51.738 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme21 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.739 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n1 | grep 'live optimized' 2026-02-18T03:54:51.784 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme25 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.785 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n1 | grep 'live optimized' 2026-02-18T03:54:51.831 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme29 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.832 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n1 | grep 'live optimized' 2026-02-18T03:54:51.878 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme33 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.879 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n1 | grep 'live optimized' 2026-02-18T03:54:51.925 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme37 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.925 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n1 | grep 'live optimized' 2026-02-18T03:54:51.971 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme5 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:51.971 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n1 | grep 'live optimized' 2026-02-18T03:54:52.017 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme41 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.018 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n1 | grep 'live optimized' 2026-02-18T03:54:52.063 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme45 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.064 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n1 | grep 'live optimized' 2026-02-18T03:54:52.111 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme49 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.112 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n1 | grep 'live optimized' 2026-02-18T03:54:52.157 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme53 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.158 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n1 | grep 'live optimized' 2026-02-18T03:54:52.202 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme57 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.204 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n1 | grep 'live optimized' 2026-02-18T03:54:52.248 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme61 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.248 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n1 | grep 'live optimized' 2026-02-18T03:54:52.292 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme65 tcp traddr=10.20.193.86,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.293 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n2 | grep 'live optimized' 2026-02-18T03:54:52.378 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme10 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.378 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n2 | grep 'live optimized' 2026-02-18T03:54:52.422 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme14 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.423 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n2 | grep 'live optimized' 2026-02-18T03:54:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:52 trial155 ceph-mon[104170]: from='client.117365 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:52 trial155 ceph-mon[104170]: from='client.142996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1593806312' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:54:52.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.86:0/3274241579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:52.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:52 trial155 ceph-mon[104170]: from='client.? 10.20.193.177:0/1801278025' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:54:52.509 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme18 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.511 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n2 | grep 'live optimized' 2026-02-18T03:54:52.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:52 trial034 ceph-mon[125822]: from='client.117365 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:52 trial034 ceph-mon[125822]: from='client.142996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1593806312' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:54:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.86:0/3274241579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:52.521 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:52 trial034 ceph-mon[125822]: from='client.? 10.20.193.177:0/1801278025' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:54:52.556 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme22 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.556 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n2 | grep 'live optimized' 2026-02-18T03:54:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:52 trial086 ceph-mon[98535]: from='client.117365 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:52 trial086 ceph-mon[98535]: from='client.142996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_type": "nvmeof", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1593806312' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-18T03:54:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.86:0/3274241579' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:52.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:52 trial086 ceph-mon[98535]: from='client.? 10.20.193.177:0/1801278025' entity='client.admin' cmd={"prefix": "nvme-gw show", "pool": "mypool", "group": "mygroup0"} : dispatch 2026-02-18T03:54:52.641 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme26 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.641 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n2 | grep 'live optimized' 2026-02-18T03:54:52.685 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme30 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.686 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n2 | grep 'live optimized' 2026-02-18T03:54:52.729 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme34 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.730 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n2 | grep 'live optimized' 2026-02-18T03:54:52.774 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme38 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.775 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n2 | grep 'live optimized' 2026-02-18T03:54:52.819 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme6 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.820 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n2 | grep 'live optimized' 2026-02-18T03:54:52.905 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme42 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.905 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n2 | grep 'live optimized' 2026-02-18T03:54:52.950 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme46 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.951 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n2 | grep 'live optimized' 2026-02-18T03:54:52.994 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme50 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:52.995 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n2 | grep 'live optimized' 2026-02-18T03:54:53.083 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme54 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.084 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n2 | grep 'live optimized' 2026-02-18T03:54:53.130 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme58 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.131 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n2 | grep 'live optimized' 2026-02-18T03:54:53.177 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme62 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.178 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n2 | grep 'live optimized' 2026-02-18T03:54:53.221 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme66 tcp traddr=10.20.193.155,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.223 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n3 | grep 'live optimized' 2026-02-18T03:54:53.268 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme11 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.269 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n3 | grep 'live optimized' 2026-02-18T03:54:53.315 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme15 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.315 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n3 | grep 'live optimized' 2026-02-18T03:54:53.360 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme19 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.361 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n3 | grep 'live optimized' 2026-02-18T03:54:53.406 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme23 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.407 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n3 | grep 'live optimized' 2026-02-18T03:54:53.452 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme27 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.453 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n3 | grep 'live optimized' 2026-02-18T03:54:53.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:53 trial155 ceph-mon[104170]: pgmap v963: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:53.497 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme31 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.498 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n3 | grep 'live optimized' 2026-02-18T03:54:53.520 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:53 trial034 ceph-mon[125822]: pgmap v963: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:53.543 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme35 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.544 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n3 | grep 'live optimized' 2026-02-18T03:54:53.590 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme39 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.591 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n3 | grep 'live optimized' 2026-02-18T03:54:53.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:53 trial086 ceph-mon[98535]: pgmap v963: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 112 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-18T03:54:53.636 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme7 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.638 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n3 | grep 'live optimized' 2026-02-18T03:54:53.682 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme43 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.683 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n3 | grep 'live optimized' 2026-02-18T03:54:53.727 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme47 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.728 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n3 | grep 'live optimized' 2026-02-18T03:54:53.773 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme51 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.774 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n3 | grep 'live optimized' 2026-02-18T03:54:53.819 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme55 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.820 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n3 | grep 'live optimized' 2026-02-18T03:54:53.867 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme59 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.867 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n3 | grep 'live optimized' 2026-02-18T03:54:53.912 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme63 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.914 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n3 | grep 'live optimized' 2026-02-18T03:54:53.959 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme67 tcp traddr=10.20.193.177,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:53.960 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme8n4 | grep 'live optimized' 2026-02-18T03:54:54.005 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme8 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.006 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme12n4 | grep 'live optimized' 2026-02-18T03:54:54.052 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme12 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.053 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme16n4 | grep 'live optimized' 2026-02-18T03:54:54.098 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme16 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.099 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme20n4 | grep 'live optimized' 2026-02-18T03:54:54.144 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme20 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.146 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme24n4 | grep 'live optimized' 2026-02-18T03:54:54.191 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme24 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.191 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme28n4 | grep 'live optimized' 2026-02-18T03:54:54.235 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme28 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.236 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme32n4 | grep 'live optimized' 2026-02-18T03:54:54.294 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme32 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.294 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme36n4 | grep 'live optimized' 2026-02-18T03:54:54.383 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme36 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.384 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme4n4 | grep 'live optimized' 2026-02-18T03:54:54.429 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme4 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.430 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme40n4 | grep 'live optimized' 2026-02-18T03:54:54.475 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme40 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.476 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme44n4 | grep 'live optimized' 2026-02-18T03:54:54.520 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme44 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.521 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme48n4 | grep 'live optimized' 2026-02-18T03:54:54.566 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme48 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.567 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme52n4 | grep 'live optimized' 2026-02-18T03:54:54.610 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme52 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.612 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme56n4 | grep 'live optimized' 2026-02-18T03:54:54.656 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme56 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.657 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme60n4 | grep 'live optimized' 2026-02-18T03:54:54.702 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme60 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.703 DEBUG:teuthology.orchestra.run.trial014:> sudo nvme list-subsys /dev/nvme64n4 | grep 'live optimized' 2026-02-18T03:54:54.747 INFO:teuthology.orchestra.run.trial014.stdout: +- nvme64 tcp traddr=10.20.193.34,trsvcid=4420,src_addr=10.20.193.14 live optimized 2026-02-18T03:54:54.748 INFO:tasks.nvmeof.[nvmeof.thrasher]:Thrasher summary: 2026-02-18T03:54:54.748 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof.a was thrashed 4 times 2026-02-18T03:54:54.748 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof.b was thrashed 4 times 2026-02-18T03:54:54.748 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof.c was thrashed 4 times 2026-02-18T03:54:54.748 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof.d was thrashed 4 times 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 0: thrashed- nvmeof.a (by ceph_daemon_stop); nvmeof.b, nvmeof.c (by daemon_remove); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 1: thrashed- nvmeof.b, nvmeof.c (by ceph_daemon_stop); nvmeof.d (by daemon_remove); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 2: thrashed- nvmeof.a, nvmeof.b, nvmeof.d (by daemon_remove); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 3: thrashed- nvmeof.b, nvmeof.d (by ceph_daemon_stop); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 4: thrashed- nvmeof.d (by ceph_daemon_stop); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 5: thrashed- nvmeof.c (by daemon_remove); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 6: thrashed- nvmeof.a (by ceph_daemon_stop); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 7: thrashed- nvmeof.c (by ceph_daemon_stop); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof.[nvmeof.thrasher]:Iteration 8: thrashed- nvmeof.a (by ceph_daemon_stop); 2026-02-18T03:54:54.749 INFO:tasks.nvmeof:done joining 2026-02-18T03:54:54.749 INFO:tasks.nvmeof:tearing down nvmeof thrasher... 2026-02-18T03:54:54.750 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof 2026-02-18T03:54:54.767 INFO:tasks.nvmeof:[nvmeof] Removing nvmeof service 2026-02-18T03:54:54.767 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls 2026-02-18T03:54:54.885 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:54:55.127 INFO:teuthology.orchestra.run.trial034.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:54:55.127 INFO:teuthology.orchestra.run.trial034.stdout:trial014 10.20.193.14 2026-02-18T03:54:55.127 INFO:teuthology.orchestra.run.trial034.stdout:trial034 10.20.193.34 2026-02-18T03:54:55.128 INFO:teuthology.orchestra.run.trial034.stdout:trial086 10.20.193.86 2026-02-18T03:54:55.128 INFO:teuthology.orchestra.run.trial034.stdout:trial155 10.20.193.155 2026-02-18T03:54:55.128 INFO:teuthology.orchestra.run.trial034.stdout:trial177 10.20.193.177 2026-02-18T03:54:55.128 INFO:teuthology.orchestra.run.trial034.stdout:5 hosts in cluster 2026-02-18T03:54:55.165 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch rm nvmeof.mypool.mygroup0 2026-02-18T03:54:55.284 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:54:55.399 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:55 trial034 ceph-mon[125822]: pgmap v964: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:55.399 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:55 trial034 ceph-mon[125822]: from='client.? 10.20.193.34:0/845818717' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:55 trial155 ceph-mon[104170]: pgmap v964: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:55.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:55 trial155 ceph-mon[104170]: from='client.? 10.20.193.34:0/845818717' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:55.533 INFO:teuthology.orchestra.run.trial034.stdout:Removed service nvmeof.mypool.mygroup0 2026-02-18T03:54:55.575 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph orch host ls 2026-02-18T03:54:55.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:55 trial086 ceph-mon[98535]: pgmap v964: 33 pgs: 33 active+clean; 16 GiB data, 56 GiB used, 5.4 TiB / 5.5 TiB avail; 75 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-18T03:54:55.623 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:55 trial086 ceph-mon[98535]: from='client.? 10.20.193.34:0/845818717' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:55.701 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:HOST ADDR LABELS STATUS 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:trial014 10.20.193.14 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:trial034 10.20.193.34 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:trial086 10.20.193.86 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:trial155 10.20.193.155 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:trial177 10.20.193.177 2026-02-18T03:54:55.941 INFO:teuthology.orchestra.run.trial034.stdout:5 hosts in cluster 2026-02-18T03:54:55.978 INFO:tasks.nvmeof:[nvmeof] Nvmeof teardown completed! 2026-02-18T03:54:55.978 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-18T03:54:55.995 INFO:tasks.cephadm:Teardown begin 2026-02-18T03:54:55.996 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:54:56.038 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:54:56.063 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:54:56.087 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:54:56.112 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T03:54:56.139 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-18T03:54:56.139 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-18T03:54:56.255 INFO:teuthology.orchestra.run.trial034.stderr:Inferring config /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/mon.a/config 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='client.148209 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.271 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.272 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-mon[125822]: from='client.? 10.20.193.155:0/2335741296' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:56.274 INFO:teuthology.orchestra.run.trial034.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-18T03:54:56.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-18T03:54:56.292 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-18T03:54:56.292 DEBUG:teuthology.orchestra.run.trial014:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:54:56.309 DEBUG:teuthology.orchestra.run.trial034:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:54:56.325 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:54:56.340 DEBUG:teuthology.orchestra.run.trial155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:54:56.356 DEBUG:teuthology.orchestra.run.trial177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-18T03:54:56.370 INFO:tasks.cephadm:Stopping all daemons... 2026-02-18T03:54:56.371 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-18T03:54:56.371 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='client.148209 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.373 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.374 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-mon[98535]: from='client.? 10.20.193.155:0/2335741296' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='client.148209 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-18T03:54:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.478 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 10.20.193.34:0/2935611001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='mgr.14152 ' entity='mgr.x' 2026-02-18T03:54:56.479 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:56 trial155 ceph-mon[104170]: from='client.? 10.20.193.155:0/2335741296' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"nvme-gw show", "pool":"mypool", "group":"mygroup0"} : dispatch 2026-02-18T03:54:56.699 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 systemd[1]: Stopping Ceph mon.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:54:56.700 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[125818]: 2026-02-18T03:54:56.475+0000 7f9f480f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:54:56.700 INFO:journalctl@ceph.mon.a.trial034.stdout:Feb 18 03:54:56 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-a[125818]: 2026-02-18T03:54:56.475+0000 7f9f480f2640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-18T03:54:56.776 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.a.service' 2026-02-18T03:54:56.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:54:56.812 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-18T03:54:56.812 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-18T03:54:56.813 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b 2026-02-18T03:54:57.102 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 systemd[1]: Stopping Ceph mon.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:54:57.103 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[98530]: 2026-02-18T03:54:56.907+0000 7faefcd79640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:54:57.103 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b[98530]: 2026-02-18T03:54:56.907+0000 7faefcd79640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:54:57.103 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:57 trial086 podman[115386]: 2026-02-18 03:54:57.039789687 +0000 UTC m=+0.144991989 container died 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-18T03:54:57.103 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:57 trial086 podman[115386]: 2026-02-18 03:54:57.049644248 +0000 UTC m=+0.154846560 container remove 14d45653e6ac2b72047a94304e77fc08cb76bee5e88b23172efe0bc82f1cddc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b, ceph=True, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-18T03:54:57.103 INFO:journalctl@ceph.mon.b.trial086.stdout:Feb 18 03:54:57 trial086 bash[115386]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-b 2026-02-18T03:54:57.127 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.b.service' 2026-02-18T03:54:57.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:54:57.162 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-18T03:54:57.162 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-18T03:54:57.162 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c 2026-02-18T03:54:57.440 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 systemd[1]: Stopping Ceph mon.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:54:57.441 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[104166]: 2026-02-18T03:54:57.271+0000 7f31bff12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:54:57.441 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c[104166]: 2026-02-18T03:54:57.271+0000 7f31bff12640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-18T03:54:57.441 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 podman[117175]: 2026-02-18 03:54:57.383873173 +0000 UTC m=+0.124332146 container died 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS) 2026-02-18T03:54:57.441 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 podman[117175]: 2026-02-18 03:54:57.392360468 +0000 UTC m=+0.132819441 container remove 062ca8d2c4c9b1342d797b5bae2ffac3760e311e6fedb2d0f866de5d71bb2df7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c, OSD_FLAVOR=debug, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-18T03:54:57.441 INFO:journalctl@ceph.mon.c.trial155.stdout:Feb 18 03:54:57 trial155 bash[117175]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mon-c 2026-02-18T03:54:57.465 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mon.c.service' 2026-02-18T03:54:57.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:54:57.501 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-18T03:54:57.501 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-18T03:54:57.501 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x 2026-02-18T03:54:57.761 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service' 2026-02-18T03:54:57.783 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 systemd[1]: Stopping Ceph mgr.x for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:54:57.783 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: 2026-02-18T03:54:57.602+0000 7f40691e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-18T03:54:57.783 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x[22082]: 2026-02-18T03:54:57.602+0000 7f40691e6640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 podman[138564]: 2026-02-18 03:54:57.654765743 +0000 UTC m=+0.065188248 container died 33dfe098994d6aeb867586965cc16aaaa4f192f0e0ef768a95c78e17f7f6a2fb (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2) 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 podman[138564]: 2026-02-18 03:54:57.684681118 +0000 UTC m=+0.095103623 container remove 33dfe098994d6aeb867586965cc16aaaa4f192f0e0ef768a95c78e17f7f6a2fb (image=quay.ceph.io/ceph-ci/ceph:adc1923395f2bcd6ae89b5d331d278364d1848ed, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 bash[138564]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-mgr-x 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service: Deactivated successfully. 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 systemd[1]: Stopped Ceph mgr.x for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T03:54:57.784 INFO:journalctl@ceph.mgr.x.trial034.stdout:Feb 18 03:54:57 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@mgr.x.service: Consumed 32.754s CPU time. 2026-02-18T03:54:57.796 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:54:57.797 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-18T03:54:57.797 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-18T03:54:57.797 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.0 2026-02-18T03:54:58.271 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:54:57 trial034 systemd[1]: Stopping Ceph osd.0 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:54:58.271 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:54:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0[35656]: 2026-02-18T03:54:57.926+0000 7ff2114d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:54:58.271 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:54:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0[35656]: 2026-02-18T03:54:57.926+0000 7ff2114d8640 -1 osd.0 61 *** Got signal Terminated *** 2026-02-18T03:54:58.272 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:54:57 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0[35656]: 2026-02-18T03:54:57.926+0000 7ff2114d8640 -1 osd.0 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:03.521 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138719]: 2026-02-18 03:55:03.219478362 +0000 UTC m=+5.303101915 container died 54d63f73c831a926ae3c0cdb96bcd52626e6f8eb96d0d19303a797d692f8825f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug) 2026-02-18T03:55:03.521 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138719]: 2026-02-18 03:55:03.228801991 +0000 UTC m=+5.312425534 container remove 54d63f73c831a926ae3c0cdb96bcd52626e6f8eb96d0d19303a797d692f8825f (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0, ceph=True, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 bash[138719]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138871]: 2026-02-18 03:55:03.362434858 +0000 UTC m=+0.016118694 container create 4d56be3734d12cc7fdd88e52d94e0424b8117d1db8222dacaf9ba1c9ada3d626 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138871]: 2026-02-18 03:55:03.399882896 +0000 UTC m=+0.053566742 container init 4d56be3734d12cc7fdd88e52d94e0424b8117d1db8222dacaf9ba1c9ada3d626 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138871]: 2026-02-18 03:55:03.403028206 +0000 UTC m=+0.056712092 container start 4d56be3734d12cc7fdd88e52d94e0424b8117d1db8222dacaf9ba1c9ada3d626 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138871]: 2026-02-18 03:55:03.403554633 +0000 UTC m=+0.057238479 container attach 4d56be3734d12cc7fdd88e52d94e0424b8117d1db8222dacaf9ba1c9ada3d626 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-0-deactivate, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True) 2026-02-18T03:55:03.522 INFO:journalctl@ceph.osd.0.trial034.stdout:Feb 18 03:55:03 trial034 podman[138871]: 2026-02-18 03:55:03.355872986 +0000 UTC m=+0.009556832 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:03.581 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.0.service' 2026-02-18T03:55:03.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:03.617 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-18T03:55:03.617 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-18T03:55:03.618 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.1 2026-02-18T03:55:04.021 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:03 trial034 systemd[1]: Stopping Ceph osd.1 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:04.021 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1[41793]: 2026-02-18T03:55:03.756+0000 7fb95d787640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:04.021 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1[41793]: 2026-02-18T03:55:03.756+0000 7fb95d787640 -1 osd.1 61 *** Got signal Terminated *** 2026-02-18T03:55:04.021 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1[41793]: 2026-02-18T03:55:03.756+0000 7fb95d787640 -1 osd.1 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:09.494 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139003]: 2026-02-18 03:55:09.16101493 +0000 UTC m=+5.415946190 container died e8f52ac3670f40732c4b84580674cf667bd64efba26b155290456723ad23a086 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:55:09.494 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139003]: 2026-02-18 03:55:09.170199766 +0000 UTC m=+5.425131026 container remove e8f52ac3670f40732c4b84580674cf667bd64efba26b155290456723ad23a086 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:55:09.494 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 bash[139003]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.302194603 +0000 UTC m=+0.018305984 container create 4a8b5fd3a3de62ac5fb47b5eb821af739813b0ebde3cc2eb3ff15ab5d58a05ab (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.3395387 +0000 UTC m=+0.055650091 container init 4a8b5fd3a3de62ac5fb47b5eb821af739813b0ebde3cc2eb3ff15ab5d58a05ab (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.342227219 +0000 UTC m=+0.058338590 container start 4a8b5fd3a3de62ac5fb47b5eb821af739813b0ebde3cc2eb3ff15ab5d58a05ab (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.342896722 +0000 UTC m=+0.059008103 container attach 4a8b5fd3a3de62ac5fb47b5eb821af739813b0ebde3cc2eb3ff15ab5d58a05ab (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0) 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.295653164 +0000 UTC m=+0.011764535 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:09.495 INFO:journalctl@ceph.osd.1.trial034.stdout:Feb 18 03:55:09 trial034 podman[139155]: 2026-02-18 03:55:09.492933503 +0000 UTC m=+0.209044884 container died 4a8b5fd3a3de62ac5fb47b5eb821af739813b0ebde3cc2eb3ff15ab5d58a05ab (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:55:09.519 DEBUG:teuthology.orchestra.run.trial034:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.1.service' 2026-02-18T03:55:09.557 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:09.557 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-18T03:55:09.557 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-18T03:55:09.557 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.2 2026-02-18T03:55:09.873 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:09 trial086 systemd[1]: Stopping Ceph osd.2 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:09.873 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2[29014]: 2026-02-18T03:55:09.665+0000 7fd2cb4a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:09.873 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2[29014]: 2026-02-18T03:55:09.665+0000 7fd2cb4a0640 -1 osd.2 61 *** Got signal Terminated *** 2026-02-18T03:55:09.874 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:09 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2[29014]: 2026-02-18T03:55:09.665+0000 7fd2cb4a0640 -1 osd.2 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:15.333 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115592]: 2026-02-18 03:55:15.019116924 +0000 UTC m=+5.365415229 container died 9eb9d6eabc00b553be29ec986461405722210df315dea5592a35479a4eef7f27 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.7, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2026-02-18T03:55:15.333 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115592]: 2026-02-18 03:55:15.029165136 +0000 UTC m=+5.375463431 container remove 9eb9d6eabc00b553be29ec986461405722210df315dea5592a35479a4eef7f27 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug) 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 bash[115592]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.164895139 +0000 UTC m=+0.016392645 container create 521940ca4a4e87671227e58b896cea0bca812a31538715f9e43875ddb0f92bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, ceph=True) 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.192259922 +0000 UTC m=+0.043757438 container init 521940ca4a4e87671227e58b896cea0bca812a31538715f9e43875ddb0f92bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.195139649 +0000 UTC m=+0.046637165 container start 521940ca4a4e87671227e58b896cea0bca812a31538715f9e43875ddb0f92bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.195620584 +0000 UTC m=+0.047118110 container attach 521940ca4a4e87671227e58b896cea0bca812a31538715f9e43875ddb0f92bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, ceph=True) 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.157795161 +0000 UTC m=+0.009292677 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:15.334 INFO:journalctl@ceph.osd.2.trial086.stdout:Feb 18 03:55:15 trial086 podman[115741]: 2026-02-18 03:55:15.332186101 +0000 UTC m=+0.183683617 container died 521940ca4a4e87671227e58b896cea0bca812a31538715f9e43875ddb0f92bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, io.buildah.version=1.33.7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug) 2026-02-18T03:55:15.365 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.2.service' 2026-02-18T03:55:15.402 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:15.402 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-18T03:55:15.402 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-18T03:55:15.402 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.3 2026-02-18T03:55:15.623 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:15 trial086 systemd[1]: Stopping Ceph osd.3 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:15.623 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3[35377]: 2026-02-18T03:55:15.532+0000 7fe0136d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:15.623 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3[35377]: 2026-02-18T03:55:15.532+0000 7fe0136d6640 -1 osd.3 61 *** Got signal Terminated *** 2026-02-18T03:55:15.623 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:15 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3[35377]: 2026-02-18T03:55:15.532+0000 7fe0136d6640 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:21.123 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:20 trial086 podman[115873]: 2026-02-18 03:55:20.865970406 +0000 UTC m=+5.344675599 container died a666da01380e19e7b4e26f7459097f18383cd8e041af7e2b9e6d2f97285d0faf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:20 trial086 podman[115873]: 2026-02-18 03:55:20.874373979 +0000 UTC m=+5.353079172 container remove a666da01380e19e7b4e26f7459097f18383cd8e041af7e2b9e6d2f97285d0faf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:20 trial086 bash[115873]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:21 trial086 podman[116021]: 2026-02-18 03:55:21.011029914 +0000 UTC m=+0.017090492 container create c35074492ea0b2bf16f2cd447a23aaf5229cb1abca4aa97724a00d5c612145cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3-deactivate, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:21 trial086 podman[116021]: 2026-02-18 03:55:21.05026037 +0000 UTC m=+0.056320948 container init c35074492ea0b2bf16f2cd447a23aaf5229cb1abca4aa97724a00d5c612145cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3-deactivate, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:21 trial086 podman[116021]: 2026-02-18 03:55:21.052760461 +0000 UTC m=+0.058821039 container start c35074492ea0b2bf16f2cd447a23aaf5229cb1abca4aa97724a00d5c612145cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:21 trial086 podman[116021]: 2026-02-18 03:55:21.053391264 +0000 UTC m=+0.059451862 container attach c35074492ea0b2bf16f2cd447a23aaf5229cb1abca4aa97724a00d5c612145cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:55:21.124 INFO:journalctl@ceph.osd.3.trial086.stdout:Feb 18 03:55:21 trial086 podman[116021]: 2026-02-18 03:55:21.004560921 +0000 UTC m=+0.010621499 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:21.229 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.3.service' 2026-02-18T03:55:21.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:55:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:55:20] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:55:21.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:21.266 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-18T03:55:21.266 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-18T03:55:21.266 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.4 2026-02-18T03:55:21.623 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:21 trial086 systemd[1]: Stopping Ceph osd.4 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:21.623 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:55:21.391+0000 7fa7c3720640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:21.623 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:55:21.391+0000 7fa7c3720640 -1 osd.4 61 *** Got signal Terminated *** 2026-02-18T03:55:21.624 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:21 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:55:21.391+0000 7fa7c3720640 -1 osd.4 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:25.341 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:25.083+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:25.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:25 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:25.339+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:26.334 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:26.054+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:26.373 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:25 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4[41833]: 2026-02-18T03:55:25.976+0000 7fa7bb4ee640 -1 osd.4 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.067356+0000 front 2026-02-18T03:55:01.067393+0000 (oldest deadline 2026-02-18T03:55:25.767438+0000) 2026-02-18T03:55:26.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:26 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:26.332+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:27.096 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116153]: 2026-02-18 03:55:26.776166288 +0000 UTC m=+5.394209041 container died 1a8d55bcdff98bb3cda11ba4fd42a7f67adc34a9f35c2de42fc05046102256dc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-18T03:55:27.096 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116153]: 2026-02-18 03:55:26.784862484 +0000 UTC m=+5.402905237 container remove 1a8d55bcdff98bb3cda11ba4fd42a7f67adc34a9f35c2de42fc05046102256dc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:55:27.096 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 bash[116153]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116301]: 2026-02-18 03:55:26.915915607 +0000 UTC m=+0.016797567 container create 0cf3f4a07f2bdbab382bdcba3a7a5bb8953f882dc1d970fc231c0eb45af746e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, ceph=True, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0) 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116301]: 2026-02-18 03:55:26.954338351 +0000 UTC m=+0.055220281 container init 0cf3f4a07f2bdbab382bdcba3a7a5bb8953f882dc1d970fc231c0eb45af746e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.build-date=20260216, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116301]: 2026-02-18 03:55:26.956661612 +0000 UTC m=+0.057543523 container start 0cf3f4a07f2bdbab382bdcba3a7a5bb8953f882dc1d970fc231c0eb45af746e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:26 trial086 podman[116301]: 2026-02-18 03:55:26.957168576 +0000 UTC m=+0.058050496 container attach 0cf3f4a07f2bdbab382bdcba3a7a5bb8953f882dc1d970fc231c0eb45af746e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, org.label-schema.build-date=20260216) 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:27 trial086 podman[116301]: 2026-02-18 03:55:26.909610609 +0000 UTC m=+0.010492529 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:27.097 INFO:journalctl@ceph.osd.4.trial086.stdout:Feb 18 03:55:27 trial086 podman[116301]: 2026-02-18 03:55:27.095411163 +0000 UTC m=+0.196293093 container died 0cf3f4a07f2bdbab382bdcba3a7a5bb8953f882dc1d970fc231c0eb45af746e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-4-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:55:27.137 DEBUG:teuthology.orchestra.run.trial086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.4.service' 2026-02-18T03:55:27.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:27.173 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-18T03:55:27.173 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-18T03:55:27.174 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.5 2026-02-18T03:55:27.355 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:27.088+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:27.355 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:27 trial155 systemd[1]: Stopping Ceph osd.5 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:27.355 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:27.273+0000 7ff9cc105640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:27.355 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:27.273+0000 7ff9cc105640 -1 osd.5 61 *** Got signal Terminated *** 2026-02-18T03:55:27.356 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:27.273+0000 7ff9cc105640 -1 osd.5 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:27.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:27 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:27.353+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:28.351 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:28.058+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:28.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:28.350+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:28.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:28 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:28.369+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:29.324 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:29.031+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:29.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:29.417+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:29.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:29 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:29.322+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:30.323 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:30.043+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:30.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:30.387+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:30.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:30.321+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:31.352 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:31.043+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:31.352 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:31.043+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.396383+0000 front 2026-02-18T03:55:06.396368+0000 (oldest deadline 2026-02-18T03:55:30.496366+0000) 2026-02-18T03:55:31.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:31.351+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:31.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:31.399+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:31.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:31 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:31.399+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:32.363 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:32.035+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.995914+0000 front 2026-02-18T03:54:59.995843+0000 (oldest deadline 2026-02-18T03:55:24.095946+0000) 2026-02-18T03:55:32.363 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5[29868]: 2026-02-18T03:55:32.035+0000 7ff9c7edb640 -1 osd.5 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.396383+0000 front 2026-02-18T03:55:06.396368+0000 (oldest deadline 2026-02-18T03:55:30.496366+0000) 2026-02-18T03:55:32.668 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:32.361+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:32.668 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:32.361+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:32.668 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:32.417+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:32.668 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:32 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:32.417+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:32.978 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117442]: 2026-02-18 03:55:32.666911669 +0000 UTC m=+5.405442566 container died e6abc9d932f681a147d9e89043800e18cdcdbabe7ad4474995a42887ccca4955 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, ceph=True, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117442]: 2026-02-18 03:55:32.677137094 +0000 UTC m=+5.415668002 container remove e6abc9d932f681a147d9e89043800e18cdcdbabe7ad4474995a42887ccca4955 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5, ceph=True, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 bash[117442]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117589]: 2026-02-18 03:55:32.803351688 +0000 UTC m=+0.016117155 container create 94a497031e1686c9cdc858babfe533d8457b1ce789c350b6c0ca2b053a4d7097 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117589]: 2026-02-18 03:55:32.839460794 +0000 UTC m=+0.052226260 container init 94a497031e1686c9cdc858babfe533d8457b1ce789c350b6c0ca2b053a4d7097 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117589]: 2026-02-18 03:55:32.842002555 +0000 UTC m=+0.054768021 container start 94a497031e1686c9cdc858babfe533d8457b1ce789c350b6c0ca2b053a4d7097 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117589]: 2026-02-18 03:55:32.842561803 +0000 UTC m=+0.055327269 container attach 94a497031e1686c9cdc858babfe533d8457b1ce789c350b6c0ca2b053a4d7097 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.7) 2026-02-18T03:55:32.979 INFO:journalctl@ceph.osd.5.trial155.stdout:Feb 18 03:55:32 trial155 podman[117589]: 2026-02-18 03:55:32.796073624 +0000 UTC m=+0.008839090 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:33.020 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.5.service' 2026-02-18T03:55:33.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:33.056 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-18T03:55:33.057 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-18T03:55:33.057 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.6 2026-02-18T03:55:33.342 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 systemd[1]: Stopping Ceph osd.6 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:33.342 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:33.195+0000 7f5b41ab2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:33.342 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:33.195+0000 7f5b41ab2640 -1 osd.6 61 *** Got signal Terminated *** 2026-02-18T03:55:33.342 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:33.195+0000 7f5b41ab2640 -1 osd.6 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:33.343 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:33.340+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:33.343 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:33.340+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:33.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:33.395+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:33.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:33 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:33.395+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:34.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:34.428+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:34.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:34.428+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:34.729 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:34.301+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:34.729 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:34.301+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:35.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:35.329+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:35.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:35.329+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:35.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:35.471+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:35.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:35.471+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:35.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:35 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:35.471+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:36.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:36.372+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:36.728 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:36.372+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:36.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:36.493+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:36.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:36.493+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:36.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:36 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:36.493+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:37.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:37.463+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:37.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:37.463+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:37.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:37.463+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:37.729 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:37.410+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:55:01.788949+0000 front 2026-02-18T03:55:01.788849+0000 (oldest deadline 2026-02-18T03:55:25.288868+0000) 2026-02-18T03:55:37.729 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:37.410+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:06.989362+0000 front 2026-02-18T03:55:06.989252+0000 (oldest deadline 2026-02-18T03:55:31.689267+0000) 2026-02-18T03:55:37.729 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6[36501]: 2026-02-18T03:55:37.410+0000 7f5b3d888640 -1 osd.6 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:11.689491+0000 front 2026-02-18T03:55:11.689521+0000 (oldest deadline 2026-02-18T03:55:36.989464+0000) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:38.509+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:38.509+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:38.509+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117722]: 2026-02-18 03:55:38.538590757 +0000 UTC m=+5.356587753 container died e8f6973a18eb41a915533e46c047175c78b616e4ec597862b8edc38209f058de (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6, CEPH_REF=20.2.1_2.17.26-baseline_2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, OSD_FLAVOR=debug, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117722]: 2026-02-18 03:55:38.547208571 +0000 UTC m=+5.365205557 container remove e8f6973a18eb41a915533e46c047175c78b616e4ec597862b8edc38209f058de (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6, io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-18T03:55:38.764 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 bash[117722]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6 2026-02-18T03:55:38.765 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117869]: 2026-02-18 03:55:38.670937268 +0000 UTC m=+0.016309284 container create 8fdf3e950786a79c551ea5459d57c840037271ac12e335ba5e44d9208be33598 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6-deactivate, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7) 2026-02-18T03:55:38.765 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117869]: 2026-02-18 03:55:38.706820931 +0000 UTC m=+0.052192957 container init 8fdf3e950786a79c551ea5459d57c840037271ac12e335ba5e44d9208be33598 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, CEPH_REF=20.2.1_2.17.26-baseline_2, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:55:38.765 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117869]: 2026-02-18 03:55:38.709187174 +0000 UTC m=+0.054559200 container start 8fdf3e950786a79c551ea5459d57c840037271ac12e335ba5e44d9208be33598 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS) 2026-02-18T03:55:38.765 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117869]: 2026-02-18 03:55:38.70975654 +0000 UTC m=+0.055128567 container attach 8fdf3e950786a79c551ea5459d57c840037271ac12e335ba5e44d9208be33598 (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-6-deactivate, org.label-schema.license=GPLv2, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:55:38.765 INFO:journalctl@ceph.osd.6.trial155.stdout:Feb 18 03:55:38 trial155 podman[117869]: 2026-02-18 03:55:38.664582604 +0000 UTC m=+0.009954620 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:38.881 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.6.service' 2026-02-18T03:55:38.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:38.916 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-18T03:55:38.917 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-18T03:55:38.917 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.7 2026-02-18T03:55:39.062 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 systemd[1]: Stopping Ceph osd.7 for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T03:55:39.475 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.060+0000 7f0d80dad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-18T03:55:39.476 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.060+0000 7f0d80dad640 -1 osd.7 61 *** Got signal Terminated *** 2026-02-18T03:55:39.476 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.060+0000 7f0d80dad640 -1 osd.7 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-18T03:55:39.476 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.473+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:39.476 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.473+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:39.476 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:39 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:39.473+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:40.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:40.486+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:40.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:40.486+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:40.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:40.486+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:41.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:41.481+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:41.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:41.481+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:41.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:41 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:41.481+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:42.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:42.488+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:42.978 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:42.488+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:42.979 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:42.488+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:42.979 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:42 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:42.488+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6812 osd.3 since back 2026-02-18T03:55:15.409735+0000 front 2026-02-18T03:55:15.409659+0000 (oldest deadline 2026-02-18T03:55:41.809900+0000) 2026-02-18T03:55:43.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:43.460+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6806 osd.0 since back 2026-02-18T03:54:59.108298+0000 front 2026-02-18T03:54:59.108376+0000 (oldest deadline 2026-02-18T03:55:27.908681+0000) 2026-02-18T03:55:43.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:43.460+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.34:6814 osd.1 since back 2026-02-18T03:55:08.409095+0000 front 2026-02-18T03:55:08.409232+0000 (oldest deadline 2026-02-18T03:55:30.709181+0000) 2026-02-18T03:55:43.728 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:43.460+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6804 osd.2 since back 2026-02-18T03:55:10.709498+0000 front 2026-02-18T03:55:10.709436+0000 (oldest deadline 2026-02-18T03:55:35.409446+0000) 2026-02-18T03:55:43.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:43 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7[42843]: 2026-02-18T03:55:43.460+0000 7f0d78b7b640 -1 osd.7 61 heartbeat_check: no reply from 10.20.193.86:6812 osd.3 since back 2026-02-18T03:55:15.409735+0000 front 2026-02-18T03:55:15.409659+0000 (oldest deadline 2026-02-18T03:55:41.809900+0000) 2026-02-18T03:55:44.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118005]: 2026-02-18 03:55:44.414240274 +0000 UTC m=+5.365523203 container died 038dc718072ec7abb53d3184af08c5a0237256b7e2b569c8a8b2328d8eefef3e (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=20.2.1_2.17.26-baseline_2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-18T03:55:44.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118005]: 2026-02-18 03:55:44.424238424 +0000 UTC m=+5.375521353 container remove 038dc718072ec7abb53d3184af08c5a0237256b7e2b569c8a8b2328d8eefef3e (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, OSD_FLAVOR=debug, ceph=True, CEPH_REF=20.2.1_2.17.26-baseline_2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-18T03:55:44.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 bash[118005]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7 2026-02-18T03:55:44.729 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118146]: 2026-02-18 03:55:44.550574525 +0000 UTC m=+0.015616646 container create 2ea946c1855bb0ff13f367ecbd638d83e343552da137dcc0d430e2c1709a67cc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=20.2.1_2.17.26-baseline_2) 2026-02-18T03:55:44.730 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118146]: 2026-02-18 03:55:44.591117567 +0000 UTC m=+0.056159708 container init 2ea946c1855bb0ff13f367ecbd638d83e343552da137dcc0d430e2c1709a67cc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-18T03:55:44.730 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118146]: 2026-02-18 03:55:44.593360078 +0000 UTC m=+0.058402219 container start 2ea946c1855bb0ff13f367ecbd638d83e343552da137dcc0d430e2c1709a67cc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, CEPH_REF=20.2.1_2.17.26-baseline_2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed) 2026-02-18T03:55:44.730 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118146]: 2026-02-18 03:55:44.593898587 +0000 UTC m=+0.058940718 container attach 2ea946c1855bb0ff13f367ecbd638d83e343552da137dcc0d430e2c1709a67cc (image=quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-osd-7-deactivate, CEPH_SHA1=adc1923395f2bcd6ae89b5d331d278364d1848ed, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, ceph=True, CEPH_REF=20.2.1_2.17.26-baseline_2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7) 2026-02-18T03:55:44.730 INFO:journalctl@ceph.osd.7.trial155.stdout:Feb 18 03:55:44 trial155 podman[118146]: 2026-02-18 03:55:44.543724733 +0000 UTC m=+0.008766854 image pull c2bc6184fe251d547d8a786d74766a31c45d6086d12bec721f3e5f2c58d3d0dc quay.ceph.io/ceph-ci/ceph@sha256:ed753f0ea50a628798b35db017c3c8a578b23968359d68e5fa3c66a5d4c2474c 2026-02-18T03:55:44.767 DEBUG:teuthology.orchestra.run.trial155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@osd.7.service' 2026-02-18T03:55:44.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-18T03:55:44.802 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-18T03:55:44.802 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force --keep-logs 2026-02-18T03:55:51.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:55:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:55:50.837191] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:01.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:00.837276] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:11.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:10.837361] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:20.837379] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:24.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:56:23.713613] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:24.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:24.035648] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:56:26.022912] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:31.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:30.837389] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:56:31.668225] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:56:33.713250] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:34.035658] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:56:36.022594] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: terminate called after throwing an instance of 'std::runtime_error' 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: what(): Lost connection to the monitor (beacon timeout). 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: *** Caught signal (Aborted) ** 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: in thread 7fd0c82fe640 thread_name:safe_timer 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 1: /lib64/libc.so.6(+0x3fc30) [0x7fd0d0080c30] 2026-02-18T03:56:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 2: /lib64/libc.so.6(+0x8d03c) [0x7fd0d00ce03c] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 3: raise() 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 4: abort() 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 5: /lib64/libstdc++.so.6(+0xa1b21) [0x7fd0d28cfb21] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 6: /lib64/libstdc++.so.6(+0xad53c) [0x7fd0d28db53c] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 7: /lib64/libstdc++.so.6(+0xad5a7) [0x7fd0d28db5a7] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 8: /lib64/libstdc++.so.6(+0xad809) [0x7fd0d28db809] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 9: /usr/bin/ceph-nvmeof-monitor-client() [0x44d988] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 10: (NVMeofGwMonitorClient::tick()+0x60) [0x4c5950] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 11: /usr/bin/ceph-nvmeof-monitor-client() [0x4b405d] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 12: (CommonSafeTimer::timer_thread()+0x130) [0x7fd0d1fa5a10] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 13: /usr/lib64/ceph/libceph-common.so.2(+0x2cb4e1) [0x7fd0d1fa64e1] 2026-02-18T03:56:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 14: /lib64/libc.so.6(+0x8b2fa) [0x7fd0d00cc2fa] 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 15: /lib64/libc.so.6(+0x110400) [0x7fd0d0151400] 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:56:37] ERROR server.py:49 (2): GatewayServer: SIGCHLD received signum=17 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:56:37] ERROR server.py:53 (2): PID of terminated child process is 19 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:56:37] ERROR server.py:199 (2): GatewayServer exception occurred 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: gateway.keep_alive() 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:56:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:56:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:56:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.c', '--gateway-address', '10.20.193.155:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.155:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.c', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:56:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:56:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.c) pid 76 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:56:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: terminate called after throwing an instance of 'std::runtime_error' 2026-02-18T03:56:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: what(): Lost connection to the monitor (beacon timeout). 2026-02-18T03:56:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: *** Caught signal (Aborted) ** 2026-02-18T03:56:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: in thread 7f4cffbc2640 thread_name:safe_timer 2026-02-18T03:56:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 1: /lib64/libc.so.6(+0x3fc30) [0x7f4d07944c30] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 2: /lib64/libc.so.6(+0x8d03c) [0x7f4d0799203c] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 3: raise() 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 4: abort() 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 5: /lib64/libstdc++.so.6(+0xa1b21) [0x7f4d0a193b21] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 6: /lib64/libstdc++.so.6(+0xad53c) [0x7f4d0a19f53c] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 7: /lib64/libstdc++.so.6(+0xad5a7) [0x7f4d0a19f5a7] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 8: /lib64/libstdc++.so.6(+0xad809) [0x7f4d0a19f809] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 9: /usr/bin/ceph-nvmeof-monitor-client() [0x44d988] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 10: (NVMeofGwMonitorClient::tick()+0x60) [0x4c5950] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 11: /usr/bin/ceph-nvmeof-monitor-client() [0x4b405d] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 12: (CommonSafeTimer::timer_thread()+0x130) [0x7f4d09869a10] 2026-02-18T03:56:38.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 13: /usr/lib64/ceph/libceph-common.so.2(+0x2cb4e1) [0x7f4d0986a4e1] 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 14: /lib64/libc.so.6(+0x8b2fa) [0x7f4d079902fa] 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 15: /lib64/libc.so.6(+0x110400) [0x7f4d07a15400] 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:56:37] ERROR server.py:49 (2): GatewayServer: SIGCHLD received signum=17 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:56:37] ERROR server.py:53 (2): PID of terminated child process is 19 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:56:37] ERROR server.py:199 (2): GatewayServer exception occurred 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: gateway.keep_alive() 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:56:38.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:56:38.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:56:38.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:56:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.a', '--gateway-address', '10.20.193.34:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.34:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.a', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:56:38.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:56:37] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.a) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: terminate called after throwing an instance of 'std::runtime_error' 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: what(): Lost connection to the monitor (beacon timeout). 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: *** Caught signal (Aborted) ** 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: in thread 7f9edd734640 thread_name:safe_timer 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 1: /lib64/libc.so.6(+0x3fc30) [0x7f9ee54b6c30] 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 2: /lib64/libc.so.6(+0x8d03c) [0x7f9ee550403c] 2026-02-18T03:56:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 3: raise() 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 4: abort() 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 5: /lib64/libstdc++.so.6(+0xa1b21) [0x7f9ee7d05b21] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 6: /lib64/libstdc++.so.6(+0xad53c) [0x7f9ee7d1153c] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 7: /lib64/libstdc++.so.6(+0xad5a7) [0x7f9ee7d115a7] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 8: /lib64/libstdc++.so.6(+0xad809) [0x7f9ee7d11809] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 9: /usr/bin/ceph-nvmeof-monitor-client() [0x44d988] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 10: (NVMeofGwMonitorClient::tick()+0x60) [0x4c5950] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 11: /usr/bin/ceph-nvmeof-monitor-client() [0x4b405d] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 12: (CommonSafeTimer::timer_thread()+0x130) [0x7f9ee73dba10] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 13: /usr/lib64/ceph/libceph-common.so.2(+0x2cb4e1) [0x7f9ee73dc4e1] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 14: /lib64/libc.so.6(+0x8b2fa) [0x7f9ee55022fa] 2026-02-18T03:56:38.715 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 15: /lib64/libc.so.6(+0x110400) [0x7f9ee5587400] 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:56:38] ERROR server.py:49 (2): GatewayServer: SIGCHLD received signum=17 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:56:38] ERROR server.py:53 (2): PID of terminated child process is 19 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:56:38] ERROR server.py:199 (2): GatewayServer exception occurred 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Traceback (most recent call last): 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: gateway.keep_alive() 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:56:38.716 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:56:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.d', '--gateway-address', '10.20.193.177:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.177:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.d', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:56:38.717 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:56:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.d) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:56:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: terminate called after throwing an instance of 'std::runtime_error' 2026-02-18T03:56:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: what(): Lost connection to the monitor (beacon timeout). 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: *** Caught signal (Aborted) ** 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: in thread 7fbcc91f3640 thread_name:safe_timer 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: ceph version 20.3.0-5234-g6393ffa2 (6393ffa23e4c39ae1481930623ce082a9fad416d) tentacle (dev - RelWithDebInfo) 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 1: /lib64/libc.so.6(+0x3fc30) [0x7fbcd0f75c30] 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 2: /lib64/libc.so.6(+0x8d03c) [0x7fbcd0fc303c] 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 3: raise() 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 4: abort() 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 5: /lib64/libstdc++.so.6(+0xa1b21) [0x7fbcd37c4b21] 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 6: /lib64/libstdc++.so.6(+0xad53c) [0x7fbcd37d053c] 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 7: /lib64/libstdc++.so.6(+0xad5a7) [0x7fbcd37d05a7] 2026-02-18T03:56:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 8: /lib64/libstdc++.so.6(+0xad809) [0x7fbcd37d0809] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 9: /usr/bin/ceph-nvmeof-monitor-client() [0x44d988] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 10: (NVMeofGwMonitorClient::tick()+0x60) [0x4c5950] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 11: /usr/bin/ceph-nvmeof-monitor-client() [0x4b405d] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 12: (CommonSafeTimer::timer_thread()+0x130) [0x7fbcd2e9aa10] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 13: /usr/lib64/ceph/libceph-common.so.2(+0x2cb4e1) [0x7fbcd2e9b4e1] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 14: /lib64/libc.so.6(+0x8b2fa) [0x7fbcd0fc12fa] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 15: /lib64/libc.so.6(+0x110400) [0x7fbcd1046400] 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:56:38] ERROR server.py:49 (2): GatewayServer: SIGCHLD received signum=17 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:56:38] ERROR server.py:53 (2): PID of terminated child process is 19 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:56:38] ERROR server.py:199 (2): GatewayServer exception occurred 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Traceback (most recent call last): 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:56:39.125 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: gateway.keep_alive() 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/server.py", line 987, in keep_alive 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: timedout = self.server.wait_for_termination(timeout=1) 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_server.py", line 1118, in wait_for_termination 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: return _common.wait(self._state.termination_event.wait, 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_common.py", line 157, in wait 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: _wait_once(wait_fn, remaining, spin_cb) 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_common.py", line 112, in _wait_once 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: wait_fn(timeout=timeout) 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 581, in wait 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: signaled = self._cond.wait(timeout) 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 316, in wait 2026-02-18T03:56:39.126 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: gotit = waiter.acquire(True, timeout) 2026-02-18T03:56:39.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:56:39.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:56:39.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:56:39.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:56:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 19 args ['/usr/bin/ceph-nvmeof-monitor-client', '--gateway-name', 'client.nvmeof.nvmeof.b', '--gateway-address', '10.20.193.86:5500', '--gateway-pool', 'mypool', '--gateway-group', 'mygroup0', '--monitor-group-address', '10.20.193.86:5499', '-c', '/etc/ceph/ceph.conf', '-n', 'client.nvmeof.nvmeof.b', '-k', '/etc/ceph/keyring'] ... 2026-02-18T03:56:39.127 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:56:38] INFO server.py:739 (2): Terminating sub process of (client.nvmeof.nvmeof.b) pid 73 args ['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)'] ... 2026-02-18T03:56:41.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:40 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:40.837401] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:41 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:56:41.668163] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:44.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:43 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:56:43.712886] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:44.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:44 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:44.035668] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:46.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:46 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:56:46.022272] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:51.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:50 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:50.837424] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:51.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:51 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:56:51.668100] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:53 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:56:53.712522] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:54.035716] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:56:54 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:56:54.482767] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:54 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:56:54.478781] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:56:54 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:56:54.484595] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:54.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:56:54 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:56:54.479362] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:56:56.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:56:56 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:56:56.021952] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:01.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:00 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:00.837510] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:01.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:01 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:01.668037] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:03 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:03.712156] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:04.035800] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:04 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:04.482402] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:04 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:04.478460] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:04 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:04.484532] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:04.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:04 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:04.479447] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:06.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:06 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:06.021631] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:11.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:10 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:10.837595] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:11.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:11 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:11.667975] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:13 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:13.711792] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:14.035885] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:14 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:14.482039] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:14 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:14.478140] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:14 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:14.484470] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:14.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:14 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:14.479532] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:16.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:16 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:16.021311] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:21.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:20 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:20.837669] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:21.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:21 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:21.667912] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:23 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:23.711434] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:24.035949] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:24 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:24.481679] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:24 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:24.477820] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:24 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:24.484407] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:24.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:24 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:24.479595] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:26.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:26 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:26.020992] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:29.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] INFO prometheus.py:129 (2): Prometheus exporter running in http mode, listening on port 10008 2026-02-18T03:57:29.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:203 (2): metadata.group is not defined 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/prometheus.py", line 201, in _get_gw_metadata 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: metadata_group = metadata.group 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: AttributeError: group 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode1: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode10: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode11: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode12: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode13: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode14: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode15: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode16: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode2: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode3: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode4: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode5: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode6: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode7: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode8: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:29] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode9: Gateway client.nvmeof.nvmeof.a is going down 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Exception in thread Thread-6: 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T03:57:29.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self.run() 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/threading.py", line 917, in run 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self._target(*self._args, **self._kwargs) 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 286, in delayed_start 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: start_exporter(self.spdk_rpc_prometheus_client, self.config, 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/prometheus.py", line 130, in start_exporter 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: REGISTRY.register(NVMeOFCollector(spdk_rpc_client, config, gateway_rpc)) 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/__pypackages__/3.9/lib/prometheus_client/registry.py", line 40, in register 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: names = self._get_names(collector) 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/__pypackages__/3.9/lib/prometheus_client/registry.py", line 80, in _get_names 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: for metric in desc_func(): 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/prometheus.py", line 39, in wrapped 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: for metric in method(self, *args, **kwargs): 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/prometheus.py", line 338, in collect 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 'spdk_version': self.gw_metadata.spdk_version, 2026-02-18T03:57:29.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:29 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: AttributeError: spdk_version 2026-02-18T03:57:31.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:30 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:30.837728] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:31.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:31 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:31.667850] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:33 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:33.711075] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:34.036007] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:34 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [2026-02-18 03:57:34.481320] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:34 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:34.477502] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:34 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [2026-02-18 03:57:34.484344] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:34.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:34 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [2026-02-18 03:57:34.479653] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:36.373 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:36 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [2026-02-18 03:57:36.020673] ctrlr.c: 178:nvmf_ctrlr_keep_alive_poll: *NOTICE*: Disconnecting host nqn.2014-08.org.nvmexpress:uuid:29b84739-6e95-4147-8ccc-2ecd5be9eabc from subsystem nqn.2016-06.io.spdk:cnode12 due to keep alive timeout. 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:37] ERROR server.py:746 (2): (client.nvmeof.nvmeof.c) pid 76 timeout occurred while terminating sub process: 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: gateway.keep_alive() 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:57:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: During handling of the above exception, another exception occurred: 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/server.py", line 744, in _stop_subprocess 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: proc.communicate(timeout=timeout) 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/subprocess.py", line 1134, in communicate 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: stdout, stderr = self._communicate(input, endtime, timeout) 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/subprocess.py", line 2021, in _communicate 2026-02-18T03:57:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.wait(timeout=self._remaining_time(endtime)) 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/subprocess.py", line 1189, in wait 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self._wait(timeout=timeout) 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/subprocess.py", line 1925, in _wait 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: raise TimeoutExpired(self.args, timeout) 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: subprocess.TimeoutExpired: Command '['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)']' timed out after 59.999996594000095 seconds 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:37] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:37] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:37] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:57:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:37 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:37] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial155) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:37] ERROR server.py:746 (2): (client.nvmeof.nvmeof.a) pid 73 timeout occurred while terminating sub process: 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: gateway.keep_alive() 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: During handling of the above exception, another exception occurred: 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/server.py", line 744, in _stop_subprocess 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: proc.communicate(timeout=timeout) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/subprocess.py", line 1134, in communicate 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: stdout, stderr = self._communicate(input, endtime, timeout) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/subprocess.py", line 2021, in _communicate 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self.wait(timeout=self._remaining_time(endtime)) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/subprocess.py", line 1189, in wait 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: return self._wait(timeout=timeout) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/subprocess.py", line 1925, in _wait 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: raise TimeoutExpired(self.args, timeout) 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: subprocess.TimeoutExpired: Command '['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)']' timed out after 59.99999664400002 seconds 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:37] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:37] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:37] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:57:38.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:37 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:37] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial034) 2026-02-18T03:57:38.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:38] ERROR server.py:746 (2): (client.nvmeof.nvmeof.d) pid 73 timeout occurred while terminating sub process: 2026-02-18T03:57:38.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Traceback (most recent call last): 2026-02-18T03:57:38.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:57:38.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: gateway.keep_alive() 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/server.py", line 990, in keep_alive 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: time.sleep(spdk_ping_interval_in_seconds) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: During handling of the above exception, another exception occurred: 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Traceback (most recent call last): 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/server.py", line 744, in _stop_subprocess 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: proc.communicate(timeout=timeout) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/subprocess.py", line 1134, in communicate 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: stdout, stderr = self._communicate(input, endtime, timeout) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/subprocess.py", line 2021, in _communicate 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: self.wait(timeout=self._remaining_time(endtime)) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/subprocess.py", line 1189, in wait 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: return self._wait(timeout=timeout) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/subprocess.py", line 1925, in _wait 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: raise TimeoutExpired(self.args, timeout) 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: subprocess.TimeoutExpired: Command '['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)']' timed out after 59.99999675400022 seconds 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:38] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:38] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:38] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 78 2026-02-18T03:57:38.714 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:38 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:38] INFO state.py:1126 (78): Cleanup OMAP on exit (discovery-trial177) 2026-02-18T03:57:38.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:38] INFO server.py:815 (2): Sending signal SIGTERM to Discovery service process 81 2026-02-18T03:57:38.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:38] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:57:38.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 03:57:38 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 03:57:38] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.c) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:38] ERROR server.py:746 (2): (client.nvmeof.nvmeof.b) pid 73 timeout occurred while terminating sub process: 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Traceback (most recent call last): 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/__main__.py", line 33, in 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: gateway.keep_alive() 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/server.py", line 987, in keep_alive 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: timedout = self.server.wait_for_termination(timeout=1) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_server.py", line 1118, in wait_for_termination 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: return _common.wait(self._state.termination_event.wait, 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_common.py", line 157, in wait 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: _wait_once(wait_fn, remaining, spin_cb) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/__pypackages__/3.9/lib/grpc/_common.py", line 112, in _wait_once 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: wait_fn(timeout=timeout) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 581, in wait 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: signaled = self._cond.wait(timeout) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 316, in wait 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: gotit = waiter.acquire(True, timeout) 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/server.py", line 62, in sigchld_handler 2026-02-18T03:57:39.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: raise SystemExit(f"Gateway subprocess terminated {pid=} {exit_code=}") 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: SystemExit: Gateway subprocess terminated pid=19 exit_code=-6 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: During handling of the above exception, another exception occurred: 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Traceback (most recent call last): 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/server.py", line 744, in _stop_subprocess 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: proc.communicate(timeout=timeout) 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/subprocess.py", line 1134, in communicate 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: stdout, stderr = self._communicate(input, endtime, timeout) 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/subprocess.py", line 2021, in _communicate 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: self.wait(timeout=self._remaining_time(endtime)) 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/subprocess.py", line 1189, in wait 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: return self._wait(timeout=timeout) 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/subprocess.py", line 1925, in _wait 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: raise TimeoutExpired(self.args, timeout) 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: subprocess.TimeoutExpired: Command '['/usr/local/bin/nvmf_tgt', '--wait-for-rpc', '-u', '-r', '/var/tmp/spdk.sock', '--lcores', '(0-3)']' timed out after 59.99999668400005 seconds 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:38] INFO server.py:233 (2): Stopping the server... 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:38] INFO server.py:835 (2): Terminating discovery service... 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:38] INFO server.py:815 (2): Sending signal SIGINT to Discovery service process 81 2026-02-18T03:57:39.124 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:38 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:38] INFO state.py:1126 (81): Cleanup OMAP on exit (discovery-trial086) 2026-02-18T03:57:39.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:38 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:38] INFO server.py:815 (2): Sending signal SIGTERM to Discovery service process 78 2026-02-18T03:57:39.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:39] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:57:39.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 03:57:39 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 03:57:39] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.a) 2026-02-18T03:57:39.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:39] INFO server.py:815 (2): Sending signal SIGTERM to Discovery service process 78 2026-02-18T03:57:39.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:39] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:57:39.713 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:57:39 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:57:39] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.d) 2026-02-18T03:57:40.122 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:39] INFO server.py:815 (2): Sending signal SIGTERM to Discovery service process 81 2026-02-18T03:57:40.122 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:39] INFO server.py:837 (2): Discovery service terminated 2026-02-18T03:57:40.123 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:57:39 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:57:39] INFO state.py:1126 (2): Cleanup OMAP on exit (gateway-client.nvmeof.nvmeof.b) 2026-02-18T03:59:58.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:59:57] ERROR cephutils.py:174 (2): Failure get number created gateways 2026-02-18T03:59:58.213 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Traceback (most recent call last): 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/cephutils.py", line 130, in get_number_created_gateways 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: rply = self.execute_ceph_monitor_command(str) 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/cephutils.py", line 50, in execute_ceph_monitor_command 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: with rados.Rados(conffile=self.ceph_conf, rados_id=self.rados_id) as cluster: 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "rados_processed.pyx", line 485, in rados.Rados.__enter__ 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "rados_processed.pyx", line 669, in rados.Rados.connect 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: rados.TimedOut: [errno 110] RADOS timed out (error connecting to the cluster) 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: [18-Feb-2026 03:59:57] INFO rebalance.py:143 (2): Auto rebalance is not supported with the curent ceph version 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Exception in thread SPDK Notifications: 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: Traceback (most recent call last): 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: self.run() 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/lib64/python3.9/threading.py", line 917, in run 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: self._target(*self._args, **self._kwargs) 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/src/control/grpc.py", line 999, in read_spdk_notifications 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: notifications = self.spdk_rpc_client.notify_get_notifications( 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: return self.call(name, remove_null(kwargs)) 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: req_id = self.send(method, params) 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: self.flush() 2026-02-18T03:59:58.214 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T03:59:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T03:59:58.215 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 03:59:57 trial177 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d[75043]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T03:59:58.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:59:58] ERROR cephutils.py:174 (2): Failure get number created gateways 2026-02-18T03:59:58.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Traceback (most recent call last): 2026-02-18T03:59:58.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/cephutils.py", line 130, in get_number_created_gateways 2026-02-18T03:59:58.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: rply = self.execute_ceph_monitor_command(str) 2026-02-18T03:59:58.623 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/cephutils.py", line 50, in execute_ceph_monitor_command 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: with rados.Rados(conffile=self.ceph_conf, rados_id=self.rados_id) as cluster: 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "rados_processed.pyx", line 485, in rados.Rados.__enter__ 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "rados_processed.pyx", line 669, in rados.Rados.connect 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: rados.TimedOut: [errno 110] RADOS timed out (error connecting to the cluster) 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: [18-Feb-2026 03:59:58] INFO rebalance.py:143 (2): Auto rebalance is not supported with the curent ceph version 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Exception in thread SPDK Notifications: 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: Traceback (most recent call last): 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: self.run() 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/lib64/python3.9/threading.py", line 917, in run 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: self._target(*self._args, **self._kwargs) 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/src/control/grpc.py", line 999, in read_spdk_notifications 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: notifications = self.spdk_rpc_client.notify_get_notifications( 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: return self.call(name, remove_null(kwargs)) 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: req_id = self.send(method, params) 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: self.flush() 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T03:59:58.624 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 03:59:58 trial086 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b[98808]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:01.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 04:00:01] ERROR cephutils.py:174 (2): Failure get number created gateways 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/cephutils.py", line 130, in get_number_created_gateways 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: rply = self.execute_ceph_monitor_command(str) 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/cephutils.py", line 50, in execute_ceph_monitor_command 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: with rados.Rados(conffile=self.ceph_conf, rados_id=self.rados_id) as cluster: 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "rados_processed.pyx", line 485, in rados.Rados.__enter__ 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "rados_processed.pyx", line 669, in rados.Rados.connect 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: rados.TimedOut: [errno 110] RADOS timed out (error connecting to the cluster) 2026-02-18T04:00:01.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: [18-Feb-2026 04:00:01] INFO rebalance.py:143 (2): Auto rebalance is not supported with the curent ceph version 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Exception in thread SPDK Notifications: 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: Traceback (most recent call last): 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self.run() 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/lib64/python3.9/threading.py", line 917, in run 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self._target(*self._args, **self._kwargs) 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/src/control/grpc.py", line 999, in read_spdk_notifications 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: notifications = self.spdk_rpc_client.notify_get_notifications( 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:01.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: req_id = self.send(method, params) 2026-02-18T04:00:01.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:01.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self.flush() 2026-02-18T04:00:01.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:01.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:01.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:00:01 trial034 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a[127699]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:03.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR cephutils.py:174 (2): Failure get number created gateways 2026-02-18T04:00:03.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.099 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/cephutils.py", line 130, in get_number_created_gateways 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: rply = self.execute_ceph_monitor_command(str) 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/cephutils.py", line 50, in execute_ceph_monitor_command 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: with rados.Rados(conffile=self.ceph_conf, rados_id=self.rados_id) as cluster: 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "rados_processed.pyx", line 485, in rados.Rados.__enter__ 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "rados_processed.pyx", line 669, in rados.Rados.connect 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: rados.TimedOut: [errno 110] RADOS timed out (error connecting to the cluster) 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] INFO rebalance.py:143 (2): Auto rebalance is not supported with the curent ceph version 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] INFO grpc.py:7215 (2): Received request to get gateway's info 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:7223 (2): Error getting SPDK version 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/grpc.py", line 7219, in get_gateway_info_safe 2026-02-18T04:00:03.100 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: ret = self.spdk_rpc_client.spdk_get_version() 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: req_id = self.send(method, params) 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.flush() 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Exception in thread [18-Feb-2026 04:00:02] INFO prometheus.py:183 (2): Stats for all bdevs will be provided 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: SPDK Notifications: 2026-02-18T04:00:03.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:219 (2): Error trying to call bdev_get_bdevs() 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/prometheus.py", line 217, in _get_bdev_info 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.spdk_rpc_client.bdev_get_bdevs() 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: req_id = self.send(method, params) 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.flush() 2026-02-18T04:00:03.102 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.run() 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/lib64/python3.9/threading.py", line 917, in run 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self._target(*self._args, **self._kwargs) 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/grpc.py", line 999, in read_spdk_notifications 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:227 (2): Error trying to call bdev_get_iostat() 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/prometheus.py", line 225, in _get_bdev_io_stats 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.spdk_rpc_client.bdev_get_iostat() 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:03.103 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: req_id = self.send(method, params) 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.flush() 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: notifications = self.spdk_rpc_client.notify_get_notifications( 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:235 (2): Error trying to call thread_get_stats() 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: Traceback (most recent call last): 2026-02-18T04:00:03.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/src/control/prometheus.py", line 233, in _get_spdk_thread_stats 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.spdk_rpc_client.thread_get_stats() 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 198, in rpc_method 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: req_id = self.send(method, params) 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.flush() 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: BrokenPipeError: [Errno 32] Broken pipe 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: return self.call(name, remove_null(kwargs)) 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.105 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 206, in call 2026-02-18T04:00:03.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode1: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.106 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: req_id = self.send(method, params) 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 156, in send 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode10: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode11: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.flush() 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: File "/usr/local/lib/python3.9/site-packages/spdk/rpc/client.py", line 152, in flush 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode12: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode13: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: self.sock.sendall(reqstr.encode("utf-8")) 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: BrokenPipeError: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode14: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [Errno 32] Broken pipe 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode15: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode16: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode2: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode3: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode4: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode5: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode6: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode7: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode8: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR grpc.py:1289 (2): Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:00:03.110 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:00:02 trial155 ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c[105840]: [18-Feb-2026 04:00:02] ERROR prometheus.py:251 (2): Exporter failed to fetch connection info for nqn.2016-06.io.spdk:cnode9: Gateway client.nvmeof.nvmeof.c is going down 2026-02-18T04:09:51.132 INFO:teuthology.orchestra.run.trial014.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:09:51.376 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force --keep-logs 2026-02-18T04:09:51.507 INFO:teuthology.orchestra.run.trial034.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:09:52.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:09:52 trial034 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T04:10:02.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 bash[139792]: time="2026-02-18T04:10:02Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a in 10 seconds, resorting to SIGKILL" 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 podman[139792]: 2026-02-18 04:10:02.168669706 +0000 UTC m=+10.034008220 container died 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, build-date=2026-02-11 09:53:49 UTC, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, architecture=x86_64, io.spdk.build.makeflags=, maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vcs-type=git, org.centos.version=9.0-30.el9, version=1.6.5, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.spdk.git.branch=undefined, io.spdk.version=25.09, com.redhat.component=ubi9-container, io.openshift.wants=ceph,rbd, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, distribution-scope=public, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.pkgdep-args=--rbd, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., release=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.ceph-release=20.2.0) 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 podman[139792]: 2026-02-18 04:10:02.180927992 +0000 UTC m=+10.046266506 container remove 13d5247ab1c8fff08192edb60e8fdf8b21d2aa947821425033f1d90d8b8893ce (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a, org.centos.version=9.0-30.el9, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, url=https://github.com/ceph/ceph-nvmeof, io.ceph.version=1.6.5, io.ceph.git.branch=devel, summary=Ceph NVMe over Fabrics Gateway, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.maintainer=Ceph Developers , io.buildah.version=1.29.0, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vendor=Red Hat, Inc., io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., version=1.6.5, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.makeflags=, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, maintainer=Ceph Developers , io.spdk.version=25.09, build-date=2026-02-11 09:53:49 UTC, name=ceph-nvmeof, release=, distribution-scope=public, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, architecture=x86_64, io.openshift.wants=ceph,rbd, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.component=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=, vcs-type=git, io.spdk.build.ceph-release=20.2.0, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, com.redhat.component=ubi9-container, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage) 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 bash[139792]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-a 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Main process exited, code=exited, status=137/n/a 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Failed with result 'exit-code'. 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T04:10:02.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.trial034.stdout:Feb 18 04:10:02 trial034 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.a.service: Consumed 16min 39.479s CPU time. 2026-02-18T04:10:02.786 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force --keep-logs 2026-02-18T04:10:02.920 INFO:teuthology.orchestra.run.trial086.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:10:03.873 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:03 trial086 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 bash[116888]: time="2026-02-18T04:10:13Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b in 10 seconds, resorting to SIGKILL" 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 podman[116888]: 2026-02-18 04:10:13.592415215 +0000 UTC m=+10.033338740 container died 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, name=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, version=1.6.5, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, org.centos.version=9.0-30.el9, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, url=https://github.com/ceph/ceph-nvmeof, maintainer=Ceph Developers , com.redhat.component=ubi9-container, io.spdk.build.makeflags=, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.pkgdep-args=--rbd, vendor=Red Hat, Inc., vcs-type=git, io.spdk.build.ceph-release=20.2.0, io.ceph.git.branch=devel, io.ceph.summary=Ceph NVMe over Fabrics Gateway, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.git.repo=https://github.com/ceph/spdk.git, release=, io.ceph.maintainer=Ceph Developers , vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.nvmeof=, build-date=2026-02-11 09:53:49 UTC, io.buildah.version=1.29.0, io.openshift.wants=ceph,rbd, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, distribution-scope=public, architecture=x86_64, io.ceph.version=1.6.5, io.spdk.git.branch=undefined, io.spdk.version=25.09) 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 podman[116888]: 2026-02-18 04:10:13.603998503 +0000 UTC m=+10.044922008 container remove 8ebc37f377b23b5ba06c40a73ff401837fef7b725f4c03ff510feaf40be8ac6b (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b, io.ceph.nvmeof=, io.spdk.git.repo=https://github.com/ceph/spdk.git, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, distribution-scope=public, io.ceph.version=1.6.5, name=ceph-nvmeof, io.ceph.git.branch=devel, version=1.6.5, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.component=ceph-nvmeof, io.buildah.version=1.29.0, io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=20.2.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.branch=undefined, io.spdk.version=25.09, io.spdk.build.pkgdep-args=--rbd, com.redhat.component=ubi9-container, io.spdk.build.target-arch=x86-64-v2, url=https://github.com/ceph/ceph-nvmeof, io.ceph.maintainer=Ceph Developers , release=, vcs-type=git, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, summary=Ceph NVMe over Fabrics Gateway, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.build.makeflags=, build-date=2026-02-11 09:53:49 UTC, org.centos.version=9.0-30.el9, architecture=x86_64, io.ceph.url=https://github.com/ceph/ceph-nvmeof) 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 bash[116888]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-b 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Main process exited, code=exited, status=137/n/a 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Failed with result 'exit-code'. 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 systemd[1]: Stopped Ceph nvmeof.nvmeof.b for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T04:10:13.874 INFO:journalctl@ceph.nvmeof.nvmeof.b.trial086.stdout:Feb 18 04:10:13 trial086 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.b.service: Consumed 1h 10min 47.578s CPU time. 2026-02-18T04:10:14.177 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force --keep-logs 2026-02-18T04:10:14.310 INFO:teuthology.orchestra.run.trial155.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:10:15.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:14 trial155 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:24 trial155 bash[118682]: time="2026-02-18T04:10:24Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c in 10 seconds, resorting to SIGKILL" 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:24 trial155 podman[118682]: 2026-02-18 04:10:24.976111796 +0000 UTC m=+10.031230546 container died 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.git.repo=https://github.com/ceph/spdk.git, vcs-type=git, io.ceph.maintainer=Ceph Developers , io.openshift.wants=ceph,rbd, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, build-date=2026-02-11 09:53:49 UTC, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.git.branch=devel, io.ceph.url=https://github.com/ceph/ceph-nvmeof, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-30.el9, io.spdk.build.ceph-release=20.2.0, vendor=Red Hat, Inc., distribution-scope=public, io.ceph.nvmeof=, io.ceph.component=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, release=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, version=1.6.5, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.spdk.version=25.09, io.spdk.build.target-arch=x86-64-v2, io.buildah.version=1.29.0, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, architecture=x86_64, io.spdk.build.makeflags=, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, io.spdk.git.branch=undefined) 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:24 trial155 podman[118682]: 2026-02-18 04:10:24.989284278 +0000 UTC m=+10.044403028 container remove 62d2283ebd8a4e86771271794e8dfc5befc6a35dc0a877096a50cf41bde60134 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, name=ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.version=1.6.5, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, distribution-scope=public, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, io.spdk.git.branch=undefined, io.ceph.url=https://github.com/ceph/ceph-nvmeof, version=1.6.5, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.makeflags=, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.ceph.nvmeof=, org.centos.version=9.0-30.el9, build-date=2026-02-11 09:53:49 UTC, release=, io.ceph.git.branch=devel, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.ceph-release=20.2.0, io.spdk.version=25.09, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.component=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, vendor=Red Hat, Inc., architecture=x86_64, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.openshift.wants=ceph,rbd, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, vcs-type=git, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI) 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:24 trial155 bash[118682]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-c 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:24 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Main process exited, code=exited, status=137/n/a 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:25 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Failed with result 'exit-code'. 2026-02-18T04:10:25.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:25 trial155 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T04:10:25.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.trial155.stdout:Feb 18 04:10:25 trial155 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.c.service: Consumed 25min 502ms CPU time. 2026-02-18T04:10:25.554 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force --keep-logs 2026-02-18T04:10:25.688 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:10:25.963 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:25 trial177 systemd[1]: Stopping Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460... 2026-02-18T04:10:36.100 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 bash[93845]: time="2026-02-18T04:10:35Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d in 10 seconds, resorting to SIGKILL" 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 podman[93845]: 2026-02-18 04:10:35.783007116 +0000 UTC m=+10.031512626 container died 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.ceph.component=ceph-nvmeof, org.centos.version=9.0-30.el9, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vendor=Red Hat, Inc., io.openshift.wants=ceph,rbd, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, version=1.6.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=25.09, maintainer=Ceph Developers , release=, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.target-arch=x86-64-v2, io.spdk.build.makeflags=, vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, build-date=2026-02-11 09:53:49 UTC, com.redhat.component=ubi9-container, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.6.5, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.nvmeof=, name=ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=undefined, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.maintainer=Ceph Developers , io.spdk.build.ceph-release=20.2.0) 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 podman[93845]: 2026-02-18 04:10:35.795457257 +0000 UTC m=+10.043962768 container remove 06e0fcc1e8ce9e9c4db1bd32a2c2d364b84ca8494fe4158a106fc4b920c1f0b9 (image=quay.io/ceph/nvmeof:devel, name=ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d, io.ceph.nvmeof=, io.spdk.version=25.09, vendor=Red Hat, Inc., release=, url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.branch=undefined, build-date=2026-02-11 09:53:49 UTC, io.spdk.build.makeflags=, version=1.6.5, io.spdk.build.ceph-release=20.2.0, io.ceph.component=ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.openshift.wants=ceph,rbd, io.ceph.maintainer=Ceph Developers , io.ceph.version=1.6.5, io.ceph.url=https://github.com/ceph/ceph-nvmeof, name=ceph-nvmeof, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vcs-type=git, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, org.centos.version=9.0-30.el9, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, maintainer=Ceph Developers , io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vcs-ref=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.git.branch=devel, io.spdk.git.commit=60b5c24409cdabac02c09cbe18cc0ab7a38690e8, io.spdk.build.configure-args=--with-idxd --with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.git.commit=94482f18983f54f577e95f27ee3e5f5e145c7fd2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, com.redhat.component=ubi9-container, architecture=x86_64, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.repo=https://github.com/ceph/spdk.git, distribution-scope=public, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.target-arch=x86-64-v2, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF).) 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 bash[93845]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460-nvmeof-nvmeof-d 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Main process exited, code=exited, status=137/n/a 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Failed with result 'exit-code'. 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 systemd[1]: Stopped Ceph nvmeof.nvmeof.d for 3ff67590-0c79-11f1-9051-d404e6e7d460. 2026-02-18T04:10:36.101 INFO:journalctl@ceph.nvmeof.nvmeof.d.trial177.stdout:Feb 18 04:10:35 trial177 systemd[1]: ceph-3ff67590-0c79-11f1-9051-d404e6e7d460@nvmeof.nvmeof.d.service: Consumed 1h 34.614s CPU time, 381.6M memory peak. 2026-02-18T04:10:36.367 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T04:10:36.394 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T04:10:36.423 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T04:10:36.451 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T04:10:36.480 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-18T04:10:36.509 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-18T04:10:36.512 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial014/crash 2026-02-18T04:10:36.513 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash -- . 2026-02-18T04:10:36.537 INFO:teuthology.orchestra.run.trial014.stderr:tar: /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T04:10:36.538 INFO:teuthology.orchestra.run.trial014.stderr:tar: Error is not recoverable: exiting now 2026-02-18T04:10:36.540 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial034/crash 2026-02-18T04:10:36.542 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash -- . 2026-02-18T04:10:36.569 INFO:teuthology.orchestra.run.trial034.stderr:tar: /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T04:10:36.569 INFO:teuthology.orchestra.run.trial034.stderr:tar: Error is not recoverable: exiting now 2026-02-18T04:10:36.571 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial086/crash 2026-02-18T04:10:36.573 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash -- . 2026-02-18T04:10:36.599 INFO:teuthology.orchestra.run.trial086.stderr:tar: /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T04:10:36.599 INFO:teuthology.orchestra.run.trial086.stderr:tar: Error is not recoverable: exiting now 2026-02-18T04:10:36.601 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial155/crash 2026-02-18T04:10:36.603 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash -- . 2026-02-18T04:10:36.629 INFO:teuthology.orchestra.run.trial155.stderr:tar: /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T04:10:36.630 INFO:teuthology.orchestra.run.trial155.stderr:tar: Error is not recoverable: exiting now 2026-02-18T04:10:36.632 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial177/crash 2026-02-18T04:10:36.633 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash -- . 2026-02-18T04:10:36.659 INFO:teuthology.orchestra.run.trial177.stderr:tar: /var/lib/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-18T04:10:36.659 INFO:teuthology.orchestra.run.trial177.stderr:tar: Error is not recoverable: exiting now 2026-02-18T04:10:36.661 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-18T04:10:36.661 DEBUG:teuthology.orchestra.run.trial034:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v OSD_DOWN | egrep -v OSD_HOST_DOWN | egrep -v OSD_ROOT_DOWN | egrep -v 'osds down' | egrep -v PG_DEGRADED | egrep -v MON_DOWN | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v CEPHADM_FAILED_DAEMON | egrep -v NVMEOF_SINGLE_GATEWAY | egrep -v NVMEOF_GATEWAY_DOWN | egrep -v 'are in unavailable state' | egrep -v 'is unavailable' | egrep -v 'is in error state' | egrep -v 'failed cephadm daemon' | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_DAEMON_PLACE_FAIL | head -n 1 2026-02-18T04:10:36.690 INFO:tasks.cephadm:Compressing logs... 2026-02-18T04:10:36.690 DEBUG:teuthology.orchestra.run.trial014:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:10:36.692 DEBUG:teuthology.orchestra.run.trial034:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:10:36.713 INFO:teuthology.orchestra.run.trial014.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T04:10:36.715 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T04:10:36.716 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log 2026-02-18T04:10:36.716 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log: 84.0% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T04:10:36.716 INFO:teuthology.orchestra.run.trial014.stderr: 94.0% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log.gz 2026-02-18T04:10:36.717 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-18T04:10:36.717 INFO:teuthology.orchestra.run.trial014.stderr:real 0m0.013s 2026-02-18T04:10:36.718 INFO:teuthology.orchestra.run.trial014.stderr:user 0m0.006s 2026-02-18T04:10:36.718 INFO:teuthology.orchestra.run.trial014.stderr:sys 0m0.014s 2026-02-18T04:10:36.732 DEBUG:teuthology.orchestra.run.trial086:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:10:36.735 DEBUG:teuthology.orchestra.run.trial155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:10:36.737 DEBUG:teuthology.orchestra.run.trial177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:10:36.753 INFO:teuthology.orchestra.run.trial034.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2026-02-18T04:10:36.753 INFO:teuthology.orchestra.run.trial034.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T04:10:36.754 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.a.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.0.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.1.log 2026-02-18T04:10:36.756 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log: 85.6% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T04:10:36.757 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mgr.x.log 2026-02-18T04:10:36.757 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log 2026-02-18T04:10:36.757 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.1.log: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T04:10:36.757 INFO:teuthology.orchestra.run.trial086.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T04:10:36.758 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log: 90.4% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log.gz 2026-02-18T04:10:36.758 INFO:teuthology.orchestra.run.trial034.stderr: 87.4% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log.gz 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.2.log 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.3.log 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.4.log 2026-02-18T04:10:36.761 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log 2026-02-18T04:10:36.762 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.b.log 2026-02-18T04:10:36.762 INFO:teuthology.orchestra.run.trial086.stderr: 85.1% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T04:10:36.762 INFO:teuthology.orchestra.run.trial086.stderr: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T04:10:36.762 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log 2026-02-18T04:10:36.762 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log 2026-02-18T04:10:36.763 INFO:teuthology.orchestra.run.trial034.stderr: 95.6% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log.gz 2026-02-18T04:10:36.765 INFO:teuthology.orchestra.run.trial155.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-18T04:10:36.765 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T04:10:36.765 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.c.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.5.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.7.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr: 85.8% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.cephadm.log.gz 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.6.log 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log: 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.6.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log: 90.3% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log.gz 2026-02-18T04:10:36.766 INFO:teuthology.orchestra.run.trial155.stderr: 87.4% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log.gz 2026-02-18T04:10:36.767 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log: 90.3% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.audit.log.gz 2026-02-18T04:10:36.767 INFO:teuthology.orchestra.run.trial086.stderr: 87.5% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph.log.gz 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr:: No such file or directory 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log: 89.4% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log.gz 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr: 88.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr: 2026-02-18T04:10:36.769 INFO:teuthology.orchestra.run.trial177.stderr:real 0m0.010s 2026-02-18T04:10:36.770 INFO:teuthology.orchestra.run.trial177.stderr:user 0m0.010s 2026-02-18T04:10:36.770 INFO:teuthology.orchestra.run.trial177.stderr:sys 0m0.010s 2026-02-18T04:10:36.770 INFO:teuthology.orchestra.run.trial086.stderr: 95.7% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log.gz 2026-02-18T04:10:36.771 INFO:teuthology.orchestra.run.trial155.stderr: 95.7% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-volume.log.gz 2026-02-18T04:10:37.001 INFO:teuthology.orchestra.run.trial034.stderr: 92.4% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-18T04:10:37.384 INFO:teuthology.orchestra.run.trial155.stderr: 93.3% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.c.log.gz 2026-02-18T04:10:37.490 INFO:teuthology.orchestra.run.trial086.stderr: 93.3% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.b.log.gz 2026-02-18T04:10:38.049 INFO:teuthology.orchestra.run.trial034.stderr: 92.3% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-mon.a.log.gz 2026-02-18T04:11:19.950 INFO:teuthology.orchestra.run.trial034.stderr: 93.0% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.0.log.gz 2026-02-18T04:11:32.171 INFO:teuthology.orchestra.run.trial086.stderr: 93.0% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.2.log.gz 2026-02-18T04:11:36.760 INFO:teuthology.orchestra.run.trial086.stderr: 93.0% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.4.log.gz 2026-02-18T04:11:40.979 INFO:teuthology.orchestra.run.trial155.stderr: 92.8% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.6.log.gz 2026-02-18T04:12:04.227 INFO:teuthology.orchestra.run.trial155.stderr: 92.7% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.5.log.gz 2026-02-18T04:12:12.154 INFO:teuthology.orchestra.run.trial034.stderr: 92.7% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.1.log.gz 2026-02-18T04:12:12.156 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-18T04:12:12.156 INFO:teuthology.orchestra.run.trial034.stderr:real 1m35.410s 2026-02-18T04:12:12.156 INFO:teuthology.orchestra.run.trial034.stderr:user 2m14.257s 2026-02-18T04:12:12.156 INFO:teuthology.orchestra.run.trial034.stderr:sys 0m5.592s 2026-02-18T04:12:17.386 INFO:teuthology.orchestra.run.trial086.stderr: 92.8% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.3.log.gz 2026-02-18T04:12:17.387 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-18T04:12:17.387 INFO:teuthology.orchestra.run.trial086.stderr:real 1m40.638s 2026-02-18T04:12:17.387 INFO:teuthology.orchestra.run.trial086.stderr:user 3m27.250s 2026-02-18T04:12:17.387 INFO:teuthology.orchestra.run.trial086.stderr:sys 0m9.080s 2026-02-18T04:12:42.484 INFO:teuthology.orchestra.run.trial155.stderr: 92.8% -- replaced with /var/log/ceph/3ff67590-0c79-11f1-9051-d404e6e7d460/ceph-osd.7.log.gz 2026-02-18T04:12:42.486 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-18T04:12:42.486 INFO:teuthology.orchestra.run.trial155.stderr:real 2m5.734s 2026-02-18T04:12:42.487 INFO:teuthology.orchestra.run.trial155.stderr:user 4m25.584s 2026-02-18T04:12:42.487 INFO:teuthology.orchestra.run.trial155.stderr:sys 0m11.864s 2026-02-18T04:12:42.487 INFO:tasks.cephadm:Archiving logs... 2026-02-18T04:12:42.487 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial014/log 2026-02-18T04:12:42.489 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T04:12:42.532 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial034/log 2026-02-18T04:12:42.533 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T04:12:53.794 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial086/log 2026-02-18T04:12:53.795 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T04:13:10.872 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial155/log 2026-02-18T04:13:10.872 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T04:13:32.701 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial177/log 2026-02-18T04:13:32.702 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T04:13:32.749 INFO:tasks.cephadm:Removing cluster... 2026-02-18T04:13:32.749 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force 2026-02-18T04:13:32.870 INFO:teuthology.orchestra.run.trial014.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:13:33.107 DEBUG:teuthology.orchestra.run.trial034:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force 2026-02-18T04:13:33.228 INFO:teuthology.orchestra.run.trial034.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:13:33.695 DEBUG:teuthology.orchestra.run.trial086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force 2026-02-18T04:13:33.814 INFO:teuthology.orchestra.run.trial086.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:13:34.459 DEBUG:teuthology.orchestra.run.trial155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force 2026-02-18T04:13:34.578 INFO:teuthology.orchestra.run.trial155.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:13:35.420 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3ff67590-0c79-11f1-9051-d404e6e7d460 --force 2026-02-18T04:13:35.539 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: 3ff67590-0c79-11f1-9051-d404e6e7d460 2026-02-18T04:13:35.697 INFO:tasks.cephadm:Removing cephadm ... 2026-02-18T04:13:35.697 DEBUG:teuthology.orchestra.run.trial014:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T04:13:35.717 DEBUG:teuthology.orchestra.run.trial034:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T04:13:35.736 DEBUG:teuthology.orchestra.run.trial086:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T04:13:35.755 DEBUG:teuthology.orchestra.run.trial155:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T04:13:35.774 DEBUG:teuthology.orchestra.run.trial177:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-18T04:13:35.792 INFO:tasks.cephadm:Teardown complete 2026-02-18T04:13:35.792 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T04:13:35.809 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T04:13:35.810 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T04:13:35.813 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T04:13:35.816 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T04:13:35.818 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T04:13:35.821 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T04:13:36.185 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T04:13:36.197 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T04:13:36.197 DEBUG:teuthology.orchestra.run.trial014:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T04:13:36.199 DEBUG:teuthology.orchestra.run.trial034:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T04:13:36.200 DEBUG:teuthology.orchestra.run.trial086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T04:13:36.202 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T04:13:36.204 DEBUG:teuthology.orchestra.run.trial177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T04:13:36.213 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-18T04:13:36.215 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-18T04:13:36.216 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-18T04:13:36.218 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-18T04:13:36.219 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:^* ntp.netlinkify.com 2 7 377 14 -14us[ -19us] +/- 7842us 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:^- time.walb.tech 3 9 377 403 -1201us[-1244us] +/- 40ms 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:^- ntp.maxhost.io 2 7 337 142 +554us[ +550us] +/- 56ms 2026-02-18T04:13:36.246 INFO:teuthology.orchestra.run.trial014.stdout:^- 198.71.50.75 3 7 377 9 +51us[ +51us] +/- 35ms 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:^* ntp.netlinkify.com 2 7 377 76 +12us[ +19us] +/- 7757us 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:^- time.walb.tech 3 9 377 398 -955us[ -964us] +/- 41ms 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:^- ntp.maxhost.io 2 6 377 9 +510us[ +510us] +/- 55ms 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial155.stdout:^- 198.71.50.75 3 6 377 10 +17us[ +17us] +/- 35ms 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial086.stdout:^* ntp.netlinkify.com 2 7 377 71 -7364ns[-9026ns] +/- 7805us 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial086.stdout:^- time.walb.tech 3 8 377 8 -994us[ -994us] +/- 47ms 2026-02-18T04:13:36.247 INFO:teuthology.orchestra.run.trial086.stdout:^- ntp.maxhost.io 2 6 377 7 +489us[ +489us] +/- 55ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial086.stdout:^- 198.71.50.75 3 6 377 10 +55us[ +55us] +/- 35ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:^* ntp.netlinkify.com 2 6 377 12 -2664ns[ -59us] +/- 7817us 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:^- time.walb.tech 3 7 377 12 -954us[-1010us] +/- 47ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:^- ntp.maxhost.io 2 6 337 77 +856us[ +801us] +/- 55ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial034.stdout:^- 198.71.50.75 3 6 377 10 -29us[ -29us] +/- 35ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:^* ntp.netlinkify.com 2 7 377 142 +6495ns[ +61us] +/- 7683us 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:^- time.walb.tech 3 8 377 142 -972us[ -918us] +/- 45ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:^- ntp.maxhost.io 2 6 377 8 +550us[ +550us] +/- 55ms 2026-02-18T04:13:36.248 INFO:teuthology.orchestra.run.trial177.stdout:^- 198.71.50.75 3 6 377 12 +150us[ +150us] +/- 35ms 2026-02-18T04:13:36.248 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T04:13:36.259 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T04:13:36.260 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T04:13:36.274 DEBUG:teuthology.orchestra.run.trial014:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T04:13:36.371 DEBUG:teuthology.orchestra.run.trial034:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T04:13:36.421 DEBUG:teuthology.orchestra.run.trial086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T04:13:36.469 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T04:13:36.515 DEBUG:teuthology.orchestra.run.trial177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T04:13:36.561 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T04:13:36.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:36.592 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T04:13:36.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:36.619 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T04:13:36.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:36.646 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T04:13:36.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:36.672 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T04:13:36.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:36.700 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T04:13:36.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T04:13:36.725 INFO:teuthology.task.internal:Duration was 3133.158846 seconds 2026-02-18T04:13:36.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T04:13:36.739 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T04:13:36.739 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T04:13:36.741 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T04:13:36.743 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T04:13:36.745 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T04:13:36.747 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T04:13:36.778 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T04:13:36.778 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T04:13:36.780 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T04:13:36.782 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T04:13:36.784 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T04:13:37.259 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T04:13:37.259 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial014.front.sepia.ceph.com 2026-02-18T04:13:37.259 DEBUG:teuthology.orchestra.run.trial014:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T04:13:37.278 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial034.front.sepia.ceph.com 2026-02-18T04:13:37.278 DEBUG:teuthology.orchestra.run.trial034:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T04:13:37.297 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial086.front.sepia.ceph.com 2026-02-18T04:13:37.297 DEBUG:teuthology.orchestra.run.trial086:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T04:13:37.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-18T04:13:37.317 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T04:13:37.336 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial177.front.sepia.ceph.com 2026-02-18T04:13:37.336 DEBUG:teuthology.orchestra.run.trial177:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T04:13:37.356 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T04:13:37.356 DEBUG:teuthology.orchestra.run.trial014:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.358 DEBUG:teuthology.orchestra.run.trial034:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.359 DEBUG:teuthology.orchestra.run.trial086:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.361 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.378 DEBUG:teuthology.orchestra.run.trial177:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.551 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T04:13:37.552 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:13:37.554 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:13:37.556 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:13:37.559 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:13:37.561 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T04:13:37.574 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T04:13:37.574 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T04:13:37.575 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.575 INFO:teuthology.orchestra.run.trial014.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T04:13:37.575 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T04:13:37.576 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T04:13:37.576 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T04:13:37.577 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T04:13:37.577 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.577 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T04:13:37.580 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T04:13:37.580 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T04:13:37.580 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.581 INFO:teuthology.orchestra.run.trial086.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T04:13:37.581 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T04:13:37.581 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T04:13:37.581 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T04:13:37.582 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T04:13:37.582 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.582 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T04:13:37.586 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T04:13:37.586 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T04:13:37.586 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T04:13:37.586 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T04:13:37.586 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T04:13:37.598 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T04:13:37.603 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T04:13:37.603 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 93.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T04:13:37.606 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T04:13:37.606 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T04:13:37.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T04:13:37.620 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T04:13:37.620 DEBUG:teuthology.orchestra.run.trial014:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T04:13:37.672 DEBUG:teuthology.orchestra.run.trial034:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T04:13:37.696 DEBUG:teuthology.orchestra.run.trial086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T04:13:37.722 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T04:13:37.747 DEBUG:teuthology.orchestra.run.trial177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T04:13:37.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T04:13:37.793 DEBUG:teuthology.orchestra.run.trial014:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.796 DEBUG:teuthology.orchestra.run.trial034:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.799 DEBUG:teuthology.orchestra.run.trial086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.802 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.805 DEBUG:teuthology.orchestra.run.trial177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.819 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = core 2026-02-18T04:13:37.822 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = core 2026-02-18T04:13:37.824 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = core 2026-02-18T04:13:37.827 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-18T04:13:37.839 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = core 2026-02-18T04:13:37.857 DEBUG:teuthology.orchestra.run.trial014:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:37.890 DEBUG:teuthology.orchestra.run.trial034:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:37.905 DEBUG:teuthology.orchestra.run.trial086:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:37.921 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:37.937 DEBUG:teuthology.orchestra.run.trial177:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T04:13:37.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T04:13:37.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T04:13:37.973 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T04:13:37.975 DEBUG:teuthology.misc:Transferring archived files from trial014:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial014 2026-02-18T04:13:37.975 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T04:13:38.020 DEBUG:teuthology.misc:Transferring archived files from trial034:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial034 2026-02-18T04:13:38.020 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T04:13:38.059 DEBUG:teuthology.misc:Transferring archived files from trial086:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial086 2026-02-18T04:13:38.059 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T04:13:38.097 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial155 2026-02-18T04:13:38.098 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T04:13:38.135 DEBUG:teuthology.misc:Transferring archived files from trial177:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:21:52-nvmeof-20.2.1_2.17.26-baseline_2-distro-default-trial/54515/remote/trial177 2026-02-18T04:13:38.135 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T04:13:38.169 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T04:13:38.169 DEBUG:teuthology.orchestra.run.trial014:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T04:13:38.172 DEBUG:teuthology.orchestra.run.trial034:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T04:13:38.175 DEBUG:teuthology.orchestra.run.trial086:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T04:13:38.178 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T04:13:38.180 DEBUG:teuthology.orchestra.run.trial177:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T04:13:38.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T04:13:38.242 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T04:13:38.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T04:13:38.260 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T04:13:38.261 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T04:13:38.264 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T04:13:38.267 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T04:13:38.270 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T04:13:38.273 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T04:13:38.279 INFO:teuthology.orchestra.run.trial014.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 04:13 /home/ubuntu/cephtest 2026-02-18T04:13:38.281 INFO:teuthology.orchestra.run.trial034.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 04:13 /home/ubuntu/cephtest 2026-02-18T04:13:38.284 INFO:teuthology.orchestra.run.trial086.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 04:13 /home/ubuntu/cephtest 2026-02-18T04:13:38.288 INFO:teuthology.orchestra.run.trial155.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 04:13 /home/ubuntu/cephtest 2026-02-18T04:13:38.289 INFO:teuthology.orchestra.run.trial177.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 04:13 /home/ubuntu/cephtest 2026-02-18T04:13:38.290 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T04:13:38.309 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T04:13:38.349 INFO:teuthology.run:Summary data: description: nvmeof/thrash/{base/install centos_latest clusters/4-gateways-1-initiator conf/{disable-pool-app} gateway-initiator-setup/16-subsys-4-namespace thrashers/nvmeof_mon_thrash workloads/fio} duration: 3133.158846139908 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-18T04:13:38.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T04:13:38.457 INFO:teuthology.run:pass